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ABSTRACT 

Based on a survey conducted in 1992 by the National 
Assessment of Educational Progress (NAEP), a study examined the types 
of writing students performed in school, the quality of their 
classroom writing, and the relationship between their classroom 
writing and their performance on the NAEP writing assessment. A 
nationally representative subgroup of more than 3,000 fourth and 
eighth graders who participated in the 1992 NAEP writing assessment 
submitted three pieces of writing that represented their best writing 
efforts and reflected different kinds of writing (narrative, 
informative, persuasive). Students were asked to give special 
preference to pieces developed using writing process strategies such 
as pre-writing activities, consulting with others about writing, and 
revising successive drafts. Teachers completed a brief questionnaire 
and students wrote a letter explaining their selections. Each student 
portfolio underwent a 3-part analysis. Major findings included: (1) 
most students submitted narrative and/or informative writing; (2) at 
fourth grade, most of the informative papers were brief and 
undeveloped; (3) most of the fourth-grade informative writing was at 
a basic level; (4) the majority of papers showed evidence that their 
writers had employed process strategies; (5) students who spent more 
time on writing performed better on their portfolio writing; and (6) 
generally, the correlation between assessment and portfolio ratings 
was low for narrative and informative writing for both grades. 
Contains 32 tables and 9 figures of data. A summary of state writing 
assessment programs, a 100-item annotated bibliography, a procedural 
appendix, administration materials, and examples of students* writing 
are attached.) (RS) 
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Executive Summary 



This report describes the classroom writing of American schoolchildren 
based on a survey conducted in 1992 by the National Assessment of 
Educational Progress (NAEP). It examines the types of writing students 
performed in school, the quality of their classroom writing, the relationship 
between their classroom writing and their performance on the NAEP 
writing assessment, as well as various instructional factors related to 
portfolio performance. 

To conduct this study, NAEP asked a nationally representative 
subgroup of the fourth and eighth graders who participated in the 
1992 NAEP writing assessment to work with their teachers and submit 
three pieces of writing from their Language Arts or English classes that 
represented their best writing efforts. Students were asked to give special 
preference to pieces developed using writing process strategies such as 
pre-writing activities, consulting with others about writing, and revising 
successive drafts. They were also asked to select pieces that represented 
different kinds of writing (i.e., narrative, informative, persuasive). 

In addition, students were asked to write a letter to NAEP explaining 
their selections, leachers were asked to complete a brief questionnaire 
describing the activities that lead to the students' writing; any use the 
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student made of process strategies; and the amount of time students spent 
on the activities. 

A nationally representative subgroup of more than 3,000 fourth 
and eighth graders who participated in the main 1992 NAEP writing 
assessment 1 participated in the special portfolio study. This represented 
about a 90 percent participation rate. 

Each student portfolio underwent a three-part analysis. First a trained 
reader analyzed the various components in the portfolio in order to gather 
descriptive information about each portfolio piece. This analysis provided 
information about the type and length of writing, as well as evidence of the 
use of process strategics. The exact agreement for the descriptive ratings 
ranged from 83 to 97 percent. 

When a portfolio contained pieces classified as narrative, informative, 
or persuasive, these same readers then applied specially designed six-level 
scoring guides to these pieces. This resulted in an evaluative score for each 
narrative, informative, and persuasive piece. The majority of the students 
each submitted at least three pieces of writing; more than 10,000 papers 
were evaluated in all. The adjacent agreement for the evaluative scoring 
ranged from 90 to 98 percent. 2 The exact agreement ranged from 51 
to 67 percent. 

A second group of specially trained readers conducted a third analysis. 
They synthesized information about the assignments and classroom 
activities that had generated the students' writing. This involved 
aggregating information from the teacher questionnaire, student letters, 
and portfolio submissions to provide information about the kinds of 
activities in which students engaged. The exact agreement for classifying 
these writing activities ranged from 85 to 95 percent. 

Major Findings 

What types of school-based writing are students doing? 

As the figure below shows, at both fourth and eighth grades, the majority of 
the students submitted narrative and/or informative writing. Thirty-seven 
percent of the fourth-grade and 28 percent of the eighth-grade submissions 
were classified as narrative. At grade 4, 43 percent of the portfolio papers 



■ Applcbce. A.M., Langei. |. A.. Mullis, I Y.S., Latham. A S.. Gentile. C.A., 1992 NAM Wntni^ Report 
t mi, (Washington, IX: National Center for Khicntion Statistics, U.S. Government Printing Office, W4) 

Adjacent agreement represi-nts the percentage of times when birth renders gave the same paper either 
the same score or a score ot onlv one p.anl difference (i.e., reader one gave the paper a score of 1 and 
reader two gave the same papor a score ol 4). 
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were informative and, at grade 8, 47 percent were informative. Only 
4 percent of the fourth-grade and 9 percent of the eighth-grade papers were 
persuasive, while 15 percent of the portfolio submissions at both grades 
were either poems, brief letters (i.e., thank you notes or invitations), skill 
sheets, or illegible due to poor handwriting or photocopying. 



(, K A l) i s 



Grade 4 

Narrative 
Informative 
Persuasive 
Other* 



Types of Portfolio Writing* 



4°» 



37°o 
43°o 



15% 



Grade 8 

Narrative 
Informative 
Persuasive 
Other* 



9°« 



28°o 



15% 



* Percentage* may not total 100 percent due to rounding error. 

+ Other = Poems, Letters (i.e., thank you notes and invitations), skill sheets and 
illegible papers. 

SOL'UCH: National Assessment of Educational Progress (NAHP), 1992 
Writing Assessment 

How good is students' school-based writing? 

The figure below presents the results of the evaluative analysis of fourth and 
eighth graders' narrative and informative writing. Because the number of 
persuasive papers submitted by fourth and eighth graders was so low, their 
persuasive writing received only preliminary analysis. Fourth and eighth 
graders' narrative writing was evaluated along the same six-level scale that 
ranged from simple descriptions of events to basic stories to elaborated 
stories. The informative writing of students from both grades was evaluated 
along the same six-level informative scale that ranged from simple listings 
of information to attempted discussions to developed discussions. 
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Evaluation of Portfolio Writing* 



Grade 4 

Narrative 
Low 
Event Descriptions 
Undeveloped Stories 

Medium 
Basic Stories 
Extended Stories 

High 
Developed Stories 
Elaborated Stories 

Informative 
Low 
Lists 

Attempted Discussions 
Medium 
Undeveloped Discussions 
Discussions 

High 

Developed Discussions 
Elaborated Discussions 

Grade 8 

Narrative 
Low 
Event Descriptions 
Undeveloped Stories 

Medium 
Basic Stories 
Extended Stories 

High 
1 )eveloped Stories 
Elaborated Stories 

Informative 
Low 
Lists 

Attempted Discussions 

Medium 
Undeveloped Discussions 
Discussions 

High 

Developed Discussions 
Elaborated Discussions 



52°.. 



46°.. 



73°.. 



1% 



23"., 



65% 



43% 



53% 



4% 



•Percentages may not tot.il 10(1 percent due to rounding error. 

SOURCE: Nntion.il Assessment of Kducatttmal Progress (NAM*). 1^2 Writing Assessment 
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Narrative writing. At fourth grade, most of the narrative papers 
submitted (52 percent) were descriptions of events or lists of related events 
that were brief and undeveloped. Forty-six percent were stories with 
some descriptive detail but little development, and only 1 percent were 
developed stories. 

By the eighth grade, only 23 percent of the narratives submitted 
were undeveloped stories. Sixty-five percent of the narratives included 
descriptive detail in at least one part of the story. However, only 12 percent 
were more developed or elaborated stories. 

For narrative writing, at both grade levels, females performed better 
than males. At grade 4, White students outperformed their Black and 
Hispanic counterparts; while at grade 8, White students outperformed 
Black eighth graders. 

Informative writing. Most of the fourth-grade informative writing 
(73 percent) was at a basic level — either listings of information or attempts 
at discussion. These papers wore presentations of topics rather than 
discussions of themes. Twenty-seven percent of the informative papers 
submitted in portfolios received medium ratings. These papers could 
be considered a discussion of a theme. They included a broad range of 
information and the writer made some attempt to relate the information in 
at least one section of the paper. Only 1 percent of the fourth-grade papers 
were developed or elaborated discussions. 

Hv the eighth grade, less than half of the informative papers 
(43 percent) were lists oi information or attempted discussions. The majority 
of informative portfolio papers (53 percent) presented a broad range of 
information and related this information in a coherent way in at least 
one section of the paper. 1 lowever, only 4 percent of the eighth grade 
informative papers were developed and organized discussions of a theme 
for specific purposes and audiences. 

For informative writing, eighth-grade females performed better than 
male eighth graders and While fourth and eighth graders outperformed 
their Hispanic counterparts. 

What process strategies were associated 
with students' best portfolio writing? 

Most of the portfolio submissions were either narrative or informative 
pieces, written to an unspecified audience, in response to multi-stage 
integrated classroom activities. I lu» majority of the papers showed evidence 
that their writers had cmploved process strategies, especially revision and 
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prewriting. About half of the students spent more than 50 minutes on their 
papers, but few students chose the topics of their writings and few papers 
were written on computer. 

Almost every teacher of the eighth graders participating in this study 
reported that they used process approaches to writing instruction as either 
a supplement to their program or as central to their instruction. Also, about 
four-fifths of the students at both grades reported that their writing was 
kept in portfolios. 

What instructional factors were associated 
with students' best portfolio writing? 

Several aspects of students' portfolio writing and their general classroom 
experiences were related to their best portfolio performance. 

At both grade levels, students who spent more time on their portfolio 
writing activities and who produced longer pieces of writing had higher 
portfolio scores. Also, the use of process strategies was related to the 
production of higher-level writing. 

In general, students who spent more time on writing, in school and out 
of school, performed better on their portfolio writing. Also, students who 
were asked to write papers of medium and long lengths, at least once or 
twice a month, performed better than those who rarely or never did so. 

How do classroom writing and timed assessment writing compare? 

At the fourth grade, the majority of the students received similar ratings 
for their NAEP narrative assessment and portfolio papers, but not for their 
informative papers. For the eighth grade, the majority of the students 
received different ratings on their portfolio and assessment papers. In 
general, the correlation between assessment and portfolio ratings was low 
for narrative and informative writing for both grades (viz. .09 to .20). 

A Note on Interpretations 

because of their basis in research, the NA1ZP survey results often help to 
confirm our understanding of how school and home factors relate to 
achievement. Although the effects of schooling and instruction are of 
prime concern, these analyses do not reveal the underlying causes of the 
relationships between background factors and performance. The NAEP 
assessment results are most useful when they are considered in light of 
other knowledge about the education system, such as trends in instructional 
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reform, changes in the school-age population, and societal demands and 
expectations. Throughout this report, references are provided to assist the 
reader in finding additional related information about the topics covered. 

Because this special study, conducted as part of the main 1992 N AEP 
writing assessment, was intended to focus on students' classroom-based 
writing, an effort was made to report on factors that most related to 
students' classroom writing. For more elaborate discussions of a range of 
home and school characteristics as they relate to writing performance, see 
the NAEP 1992 Writing Report Card? 



* Applcbw, A.N., Langer, J.A., Mullis, I.V.S., Latham, A.S., and Gentile, C.A., NAl'.P 1992 Wrttm$ 
Report Card (Washington, DC: National Center for Kducation Statistics, U.S. Government Printing 
Office, 1W4). 
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Parti 



Assessing Students' Classroom-Based Writing 



Part I of this report presents the procedures used to assess the classroom- 
based writing students submitted in their NAEP portfolios. Chapter One 
summarizes the procedures used to describe and classify the writing 
students submitted. Chapter Two presents the guides used to evaluate 
this writing and the results of this evaluation. In Part II, a variety of 
instructional characteristics and features of students' best portfolio writing 
are discussed. Also, students' level of performance on the NAEP writing 
assessment and the level of their best portfolio pieces are compared. 

The body of the report is supplemented with several appendices. 
The first two appendices contain a summary of state writing assessment 
programs and an annotated bibliography on portfolio assessments. Next 
is a procedural appendix. The last two appendices contain copies of the 
administration materials and additional examples of students' classroom- 
based writing. 
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General Background on Writing Portfolios 

Over the past several years, teachers and educators have been exploring 
and developing ways to use portfolios of students' writing to facilitate 
instruction and assessment. Practitioners in other fields, such as art and 
architecture, have long used folios and portfolios as a way of collecting, 
reviewing, selecting, and presenting their work. Writing teachers and other 
educators have embraced this concept and adapted it in various ways for 
use with process-oriented writing curricula. 

The use of writing portfolios seems a natural outgrowth of the process 
approach to writing instruction - an obvious next stage in the development 
of a community of writers within a classroom or school. The use of 
portfolios to help students collect, review, select, and present their work 
accomplishes several goals of the process writing curriculum. 

First, portfolios provide a means for collecting the various materials 
and drafts students may have produced when they composed their pieces 
of writing. Keeping students' work in portfolios facilitates the reviewing 
and revising activities so essential to writing process curricula. It also 
provides a way to collect evidence of growth over time in students' writing 
and encourages students to be responsible for their work. 

Second, students' use of portfolios to organize and select their work 
gives them experience at evaluating their own writing and opportunities 
to develop the critical thinking skills necessary to become effective waters. 
Lastly, the use of portfolios within a process curriculum provides a genuine 
context for students' writing. It helps students become more aware that each 
piece of writing has a specific audience and purpose, and that their work 
reflects their continuing growth as a writer. 

Portfolios and Assessment. Because portfolios provide an excel lent 
record of the breadth and depth of students' writing, an increasing number 
of teachers have been using portfolios to evaluate students' writi. » abilities 
and their growth over time. Individual teachers and schools have developed 
ways of structuring the creation and evaluation of portfolios that suit their 
goals and curricula. To match the richness of the information portfolios pve 
about students' abilities and growth, teachers have had to develop tmnv 
complex and dynamic ways of evaluating portfolios than thev had used 
with more traditional assessment methods. 

At the same time, educators have been questioning traditional methods 
ol evaluation and the degree to which these methods match the nevve. 
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curricula, such as process writing programs. 4 Assessment specialists began 
to expand the traditional definitions of test validity to include the concept of 
ecological or external validity evidence — the kinds of evidence acceptable 
in considering the validity of a test must be related to schools' instructional 
goals and students' experiences in the classroom. 

Thus, as individual teachers and schools began using portfolios within 
their process writing curricula, educators at the district and state levels 
began to consider using portfolios for assessment purposes. In the past 
several years, many schools, districts, and states have developed poittolio 
assessment programs. Regional organizations, such as the Northwest 
Evaluation Association in Oregon, and niition.il organizations sin h as the 
National Writing Project, have been condui ting i onterences, publishing 
papers, and collecting research about the use ol poilloliu assessment 
programs at all levels. NAPP's recent survev ol stale willing assessment 
programs indicates that almost till v pen cnl ol Ihe ''late', aie * nusidering 
implementing portfolio assessments (see Appendix A lot inlm malion 
about state writing assessment piogiauis) 

Various Approaches In Willing hutlnlins V. nnliv iduals, si bonis, 
districts, and stall's hav e been » b v eloping w iitlng poillolio programs to use 
for instructional and assessment pinpnsi-.. dilletent Kinds ol portfolios have 
been developed to meet then v ai nuts goal 1 , and needs Some portfolios span 
a semester, others a si hool \ eai. w lule nil in evlend at mss several years. In 
some schools, stiulenls begin then pmllolios in elemenlaiv si hool and 
continue adding to Ihem until high si hunt gi aduaiinn In some programs, 
students develop poi Hollos ol then \\m I In all subjei (s; n other programs, 
the focus is on Iheii vvoi k in leading, w i ihng, and language arts. 

Portfolios developed sprulwalK lot assessment purposes sometimes 
include only work horn students' tegulai i lassiooin at tlvitles. At other 
times, they Incorporate sludenls' lesponses In i oinmon topics, prompts, or 
activities. In some i ases, students ami leai heis selei I work tor inclusion in 
the portfolio; in other eases, Ihe students dei ide what pieces to include. 
Depending on who will ultimately evaluate the portfolio, students may be 
asked to comment on their work and /or teachers mav be asked to describe 
the classroom contexts in which the writing activities occurred. 

Through all these variations, the beginnings ol .1 common definition ol 
writing portfolios are emerging. The following description of a portfolio was 
presented to the participants in the portfolio project ol the IWH California 
Assessment Program: 

4 Sri* Appriuiix H lor rrfcrrm ^ l<» >ti ti< Irs <>n |»nu rss w t it mj; .tms 
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Student portfolios contain samples of student performance collected 
over the school term to demonstrate the product and process of 
learning. . . Samples of student work should be self-selected as 
well as teacher-selected to show evidence of students' learning 
strategies, strengths, and current difficulties. This type of assessment 
encourages students to assume responsibility for their learning. . . 
In addition, when students select samples of their own work for 
inclusion in a portfolio they demonstrate higher level thinking 
skills of analysis and evaluation. 5 

In 1990, a working definition emerged from a conference sponsored 
by the Northwest Evaluation Association: 

A portfolio is a purposeful collection of student work that exhibits 
the student's efforts, progress and achievements in one or more 
areas. The collection must include student participation in selecting 
contents, the criteria for selection, the criteria forjudging merit, and 
evidence of student self-reflection. 6 

In IWI, the following addendum appeared in the professional 
lileralure on this subject: "The portfolio communicates what is learned and 
v\ hv it is important." 7 

I or more detailed discussions of writing portfolios, see Appendix B, 
v\ hit h contains an annotated bibliography of publications about portfolio 
|»io|n ts ai loss the United States, England, and Australia. 

( nlli't-ling Students' NAEP Portfolios 

I ho IW2 NAIvP Portfolio Study. In 1992, as part of its ongoing efforts to 
assess the writing ability of American students, the National Assessment of 
I ilu< ational Progress (NAEP) conducted a special writing portfolio study. 

Hased on its prior experience collecting, describing, and evaluating the 
si hool based writing of students across the country (see the 1990 NAEP 
pilot portfolio study)," NAEP designed a more extensive study of students' 

I illm.nr I min i! School Uihtrit-t/CAP Portfolio Project — fin.il draft of K-12 Language Arts 
I i.itnrwnrk modeled on State's l-nglish/ Language Arts Framework 1989. 

What Al.iJr. / Pottfohoit Portfolio? cf. Also, Hun* Do Portfolio, Measure lip?: A Co$nitiiY Model for 
\ -r iu.v Potlfoho; (l-KIO, Paper presented at the 1990 Conference on Aggregating Portfolio Data 
ami While t\ti>er on A^re^Uins: Portfolio Data, rev. ed. (1990). Meyer, C. and Chulman, S. (NKA). 

PauKon. I 1 ami Paulson, P.K , "What makes a portfolio a portfolio?" in iUiuctitiotuil Uattenltiv 
lehiuarv, l'io| * 

< .cnlilr. I . / i/>fm m x * New Methods for Collecting Student*' School luwtl Writing NAtlP's 1990 Portfolio 
Sfi<i/i/. (Washington, IK' National C enter lor Iducation Statistics, Office of Educational Research and 
Impiowmenl, V s Depailmenl ot hhuation, At -il W2) 
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classroom-based writing in 1992. The main purposes of this study were: 
(1) to explore procedures for collecting multiple samples of classroom-based 
writing from students around the country; (2) to refine methods for 
analyzing and evaluating the diversity of writing submitted; and (3) to 
develop ways to present information about students' writing that are 
appropriate to a wide audience. 

This 1992 N AEP portfolio study addresses three aspects of writing 
portfolios: student involvement in the selection of writing samples 
submitted, the inclusion of multiple samples of student work collected 
over time, and the examination of information about teacher assignments 
and student attitudes towards their own writing. 

To this end, a nationally representative subgroup of the fourth and 
eighth graders who participated in NAEP's 1992 writing assessment was 
asked to work with their teachers and submit three pieces of writing from 
their Language Arts or English classes that represented their best writing 
efforts. They were asked to give special attention to pieces developed using 
writing process strategies such as pre-writing activities, consulting with 
others about writing, and revising successive drafts. They were also asked 
to submit pieces that represented different types of writing, such as 
narrative, informative, and persuasive writing. 

Students were also asked to write a letter to N AEP explaining their 
selections. Teachers were asked to complete a brief questionnaire describing 
the activities that led to the students' writing; any use the student made 
of process strategies; and the amount of time spent on the activities. 

While the N AEP portfolio provides a window into writing classrooms 
across the country, it does not analyze the performance of students on an 
individual basis nor does it collect samples of their work across the school 
year. Therefore, while it can address some of the issues central to classroom 
portfolios, it cannot address others such as growth over time. 

The Participants. Approximately 3,600 students — 1,800 at grade 4 
and another 1,800 at grade 8 — were invited to participate in the special 
portfolio study. Approximately 1,600 (89 percent) of the fourth graders 
and 1,650 (91 percent) of the eighth graders who were asked to participate 
submitted portfolios. Based on traditional NAEP scientific sampling 
procedures, 9 this group can be considered a nationally representative 
sample of the nation's fourth and eighth graders. (Appendix C contains 



• For details about the sampling procedures see 7 lie NAt V I'M: Tirlmiatt Report. (Washington DC: 
National Center for Education Statistics, U.S. Government Printing Office. 1 W4). 
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demographic information about the participating students.) These students 
had also participated in the 1992 NAEP writing assessment. 

The Main 1992 NAEP Writing Assessments. The 1992 writing assessment 
was a new NAEP assessment comprised of informative, narrative, and 
persuasive writing tasks. The goal of the NAEP writing assessment was 
to evaluate the writing abilities of American students. To accomplish 
this, NAEP asked nationally representative samples of fourth- eighth- 
and twelfth-grade students attending public and private schools - 
approximately 30,000 in all - to respond to a variety of writing tasks Nine 
different writing tasks were used at grade 4, and 11 different tasks were 
used at grade 8. A planning page was included after each prompt to 
encourage students to reflect on the assigned topic and plan their responses 

According to a carefully determined sampling design, each student 
in the assessment had completed either two 25-minute writing tasks or 
one requiring 50 minutes (at grade 8), along with a series of background 
quest.ons. Teachers of the eighth-grade students were also asked a set of 
questions about their own backgrounds and educational experiences 
At each grade approximately 1,500 students responded to each task' 

Twined readers evaluated the papers according to scoring guidelines 
tailored for each task and encompassing six categories: Response to Topic 
Un,Uwh W d Respond Minimally Developed, Developed, Elaborated and 
Lxtensweh, UabonUed. The exact agreement for these ratings, averaged 
across the tasks at all three grades, was 81 percent. This scoring guide 
presents the basic criteria used to evaluate students' responses to the main 
NAM assessment, although these criteria were tailored to suit the specific 
«» m retll,i,Vments of ™ ch wri "ng task. The results of the main 
- NAN writing assessment are presented in the N/1/7' W> Writinv 
Report Card." ,N 

The Portfolio Study Procedures. In the fall of 1991, the teachers of schools 
part.cpating in the main NAEP writing assessment were contacted and 
informed that some of their students would be participating in the portfolio 
study. A brief description of this study was given to them at this time 
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Teachers were also given a copy of the report on NAEP's 1990 pilot portfolio 
study so that they could see how their students' classroom-based writing 
would be analyzed and evaluated. 

In the spring of 1992, during the week of the writing assessment, 
teachers were provided with portfolio folders for the selected students to 
use in assembling their work. Directions to the students and teachers were 
printed on the cover of the folders, as were guidelines for selecting papers. 
Students were asked to select three of their best pieces of writing, to include 
any evidence of process strategies used in the production of these pieces, 
and tc write a brief letter to NAEP explaining why they selected these 
pieces. Teachers were then asked to review the students' selections and 
answer a brief questionnaire about the instructional activities that 
generated the students' writing. Appendix D contains a copy of the first 
letter to the teachers, the front cover of the NAEP portfolio folder, and the 
teacher questionnaire. 

NAEP field administrators provided assistance to teachers and 
students when needed, making photocopies (if students' work for inclusion 
in the portfolios and helping to answer questions about the project. A week 
after delivering the portfolio folders, the field administrators returned to the 
classroom to collect the folders. 

The number of papers submitted by the students in this study is shown 
in the table below. The majority of the students in both grades included at 
least three pieces of writing in their NAEP portfolios. Thirty-six percent of 
the fourth graders and 35 percent of the eighth graders submitted one or 
two pieces. Six percent of the fourth graders and 13 percent of the eighth 
graders did not include any writing in their folders. 



Number of Papers Collected in NAEP Portfolios 



PERCENT OF STUDENTS 
Number of Papers Grade4 State 8 

0 6 13 

1 10 12 

2 26 23 

3 54 49 
4 or more 5 3 



Total Number of Papers 5.242 5.781 

SOURCE: Nation.il Assessment of I'duoUUilwl Prioress (NAIT). 1" 1 '2 
Writing Assessment 
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Analyzing the Portfolio Papers. After collection, each student portfolio 
underwent a three-part analysis. First, the writing submitted in the portfolio 
folders was classified and various features of each piece were described 
This analysis provided information about the type and length of writing 
submitted and any information available about the kinds of process 
strategies used in its production. 

The second analysis involved classifying the types of classroom 
activities or assignments that had generated the writing. Trained readers 
synthesized information from the teacher questionnaire, student letter 
and from the writing itself in order to determine what type of activity had 
been used. ' 

In the third analysis, portfolio pieces classified as narrative, 
informative, or persuasive were evaluated. Specially designed six-level 
scoring guides were used to evaluate each portfolio piece. While similar to 
the guides used in the main 1992 NAEP writing assessment, these portfolio 
guides were designed to be applied to a wide range of narrative, 
informative, and persuasive writing. 

After students' portfolio submissions had been analyzed for descriptive 
features and their narrative, informative, and persuasive papers had been 
evaluated, several methods for describing students' overall portfolio 
performance were explored. First, coding the level of their entire portfolio 
was considered. This.approach was not feasible because the portfolios came 
from such a wide variety of classrooms. Next, calculating a mean or median 
ot each students' narrative and informative papers was considered This 
proved problematic, because each paper had a unique set of descriptive 
features and averaging these features was not appropriate. Instead, the best 
narrative and informative submission from each student were selected for 
further analysis. 

In Part I of this report, the procedures used to analyze the portfolios 
and the preliminary results of this analysis for all of the papers submitted 
are presented. Part II focuses on students' best narrative and informative 
portfolio submissions. The first chapter in Part I presents the results of the 
descriptive analysis and the classification of classroom activities. In Chapter 
Two, the results of the evaluative analysis are presented, along with 
examples of students' writing. 
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1 

Describing Students' Portfolio Writing 



Introduction 



The first step in analyzing multiple samples of students' classroom-based 
writing was to describe and classify the wide diversity of writing submitted 
by the participants. Considering that no more than eight students from any 
single class were selected to participate in this study, 12 most of the papers 
submitted were responses to unique classroom activities. The corpus of 
writing submitted was so diverse that every paper could have been 
evaluated with a unique set of criteria, which would have made comparing 
students' classroom-based writing impossible. The challenge, then, was to 
develop descriptive criteria that would yield useful information about the 
types of writing students submitted. Once this was accomplished, the next 
step, moving beyond describing papers to evaluating performance, 
could be addressed. 



,: ! : or a discussion of sampling procedure hv Ihc S.M l } l iU ^2 h\hnn'ttl Rfpoit, (Washington, IK". 
National Center for Education Statistics. V ^ (io\ eminent Printing Of I tee, |W4) 
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To accomplish the task of describing the writing submitted, a panel of 
writing experts was assembled. Each member had experience developing 
writing portfolio programs at the school, district, or state level. After 
reading a large sample of the students' papers, the panel developed a series 
of descriptive categories to capture the key features of the students' papers. 
These categories focused on: (1) the types of writing submitted; (2) evidence 
of resources used; and (3) evidence of process and revision strategies 
used. Also noted were (4) evidence of computer use; (5) length of text; and 
(6) time spent producing the text. A group of trained readers then n d each 
of the papers submitted in students' portfolios and applied these descriptive 
categories to the papers. 



Types of Writing 

Students' portfolio submissions were each classified into one of six 
categories: narrative, informative, persuasive, poems, letters (i.e., 
invitations and thank you notes), and skill sheets. At an early stage in 
classifying students' papers, a distinction was made between personal 
experience narratives and fictional narratives, and between informative 
reports and analytical reports. n The panelists believed that these 
differentiations would accommodate and acknowledge the variety within 
both the narrative and expository domains. However, during the process 
of developing the scoring guides, the scoring guide developers found that 
the same criteria could be applied to various types of narratives and to 
various types of reports. Thus, the same scoring guide could be used for 
both types of narratives and the same scoring guide for both types of 
exposition. NAEP classified the papers in these domains, therefore, as 
either narrative or informative. 

Any piece of writing that fit a common poetic pattern was classified 
as a poem. Thank you notes and invitations, because they were written 
for very specific purposes and were so brief, were classified as letters. 
However, letters which contained an opinion or argument were considered 
persuasive; letters that related a story or sequence of event were considered 
narrative; and letters that discussed a topic were classified as informative. 

A small percentage of teachers in both grades (1 to 4 percent) 
commented that they did not begin teaching writing until later in the school 
year. As a result, they did not have samples of extended pieces of student 

" I'hese <.ate>;ories eie basetl mi those used l»\ the California Assessment Program, l ( >8 ( ). 
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•*-nting to submit. Instead, those teachers sent in copies of work sheets, short 
answer quizzes, or spelling lists, all of which were classified as skill sheets. 

As shown in Table 1 . 1, at both grades 4 and 8, a high percentage of 
writing submitted was classified as informative (43 and 47 percent, 
respectively). The next largest category for both grade levels was narrative 
writing — 37 percent of the fourth-grade and 28 percent of the eighth-grade 
portfolio submissions were classified as narrative. Only 4 percent of 
the fourth-grade and V percent of the eighth-grade submissions were 
persuasive. Few papers were classified as poems, letters, or skill sheets. 



Table 1.1 

Types of Writing* 





Grade 4 


Grade 8 




Percentage 


Percentage 


Narrative 


37(1.2) 


28(1.2) 


Informative 


43(1.1) 


47(1.5) 


Persuasive 


4 (0.4) 


9(0 7) 


Poems 


6(0.5) 


6(0 5) 


Letters 


4 (0.3) 


2 (0.3) 


Skitl Sheets 


4 (0.5) 


1 (0.2) 


Total Number of Papers 


N = 5,242 


N = 5.781 



lhe standard errors of tlu' estimated pereent.i^es appear in 
parentheses. !l cm lv said with ^ percent confidence tor each 
population ol interest that the value lor the whole popuKition is 
within plus or minus two standaid otiors ol the estimate for the 
sample In comparing two I'shmatrs, one muM use the standard error 
ol thr diflereiue (sit Pro* eduul Appendix Uw details) IVn enlaces 
niav not tola! 1 00 peicent due to founding eitot 

* fivo percent o! tin* papeisal j;rade I and ? percent at pjadc H were 
unr.it.ibk' due lo ille)*ihiht\ 01 pool pholot opv tjualilv 

SOURlT: National Assessment ol I diualinn.il 1'io^iess (NAI V), 
Writing Assessment 

The ability of the readers to classify types of writing reliably was 
assessed. The percent of exact agreement between readers was calculated for 
30 percent of the papers. These papers received a blind second scoring — 
the second reader could not see the score given to the paper by the first 
reader. (The remaining papers were scored by one reader.) Exact percentage 
agreement above 81) is considered strong. At grade 4, the percent exact 
agreement was 84. At grade 8, the percent exact agreement was 83. 
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Evidence of the Use of Writing Process Strategies 



When analyzing the students' papers, the readers also looked tor evidence 
of the use of writing processes, such as prewriting activities, peer or teacher 
collaboration, or revisions of drafts. To locate this evidence, the readers 
considered students' submissions as well as information from the teacher 
questionnaires and student letters. 

Table 1.2 presents the results of this analysis. At both grade levels, 
revision was the most common strategy utilized, followed hv prewriting 
(brainstorming, reading, discussing with family or friends), peer 
conferencing, and teacher editing. Strategies used lessolten were teacher- 
conferencing, use of resources (library, resoimc bonks, eh .), peer editing, 
and publication/sharing. Overall, hi percent ol the Inuilh graders' and 
6h percent of the eighth graders' portlolio \vi tting demonstrated use o| at 
least one type of process strategy 



Table 1.2 

Evidence of the Use 

of Writing Process Strategies* 





Grade 4 


flrmfe H 




Percentage 


Perceittaye 


Prewriting 


?6(1 ?) 


;«MI :i) 


Peer Conferencing 


17(1 t) 


Id ((] ( D 


Teacher Conferencing 






Use of Resources 


5 (0 <1) 


4 (Oii) 


Revising 


40 (t 3) 


44 CM)) 


Peer Editing 


9(0 7) 


11 (0!l) 


Teacher Editing 


15(1.0) 


?UH) 


Publication/Sharing 


11 (0.9) 


G (0 fl) 


No evidence provided 


39(1.5) 


34 (1 0) 



I lu- standard orrors ol tho estimated ponont. i^rs appear in 
parentheses. II urn ho said with l »S percent lonfideiue lot oaih 
population ol interest lli.it I ho voluo lor I ho wholo population is 
within plus or minus two standard errors of Iho estimate lor tho 
simple In comparing ,wo estimates, one must use Iho standard orror 
of llio dillerenee (see Procedural Appendix for details). Percentages 
mav not total 100 percent duo to rounding error 

•Note. Papers i an havo mitltiplo Ivpos i>f writing pnuoss strategies 
! leneu, Iho perconts in a column are greater th.it 1(H) ponont 

StU'Kl I ■ National Assessment ot 1 tluuilion.il Progress (NJAI P), 
l«'«»2 Willing Assessment 
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The participating teachers and students were requested to include 
in the portfolio any drafts available for each piece. At the fourth grade, 
15 percent of the writing selections included draft versions along with final 
versions of the work. At the eighth grade, 17 percent of the selections had 
draft versions. 

The ability of the readers to classify evidence of writing process reliably 
was assessed. The same blind scoring method used in the two previous 
analyses was used for this analysis. At the grade 4, the percent exact 
agreement was At the grade 8, the percent exact agreement was %. 

Length of Papers 

( )ne henelil nl using students' i lasstoom -based writing tor assessment is 
that, tinder regulai i lassioom situations, students have time to write longer 
texts than thev do mulei limed assessment conditions. The length of 
i lassioom based paper, submitted hv the fourth graders in this study 
langed I loin six winds to .\<>(H) words, with a median length of 95 words. 
I Wo peu enl ol the lourlh grade papers exceeded S00 words. The length of 
i lassioom based papris submitted by the eighth graders ranged from seven 
words to \,7 { H) words, with a median length of Ihh words. Ten percent of the 
eighth-grade papers exceeded 500 words. 

Time Spent on Writing Activity 

Another benefit ot using students' classroom-based writing for assessment 
is that students have more time to produce a piece of writing than they 
would under timed assessment conditions. Professional writers frequently 
revise their work, reformulate goals, and collaborate with peers when 
completing a piece. F laving time to rewrite, to revise, and to collaborate 
is an important element of writing process instruction, 14 

Table 1.3 presents information about the time students spent producing 
their portfolio submissions, according to their teachers, Forty-six percent of 
the fourth-grade and 57 percent of the eighth-grade portfolio submissions 
involved more than 50 minutes spent on the writing. This suggests that 
these selections were written over a period of at least two writing sessions. 
In contrast, only 1f> percent of the fourth-grade and 10 percent of the 
eighth-grade submissions were written in less than 25 minutes, 

M MofMI.| .mil \V,ij*nci It I , ^tuJt'tit i i*m/i»h/ / .men./*," H ' lotttth t'thtion (IWtMUouth. M 1 

ttnvntun 't onk I'llMlslii-ts. l l ' l 'J) 
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Table 1.3 

Time Spent on Writing Activity 



Grade 4 
Percentage 



Grade 8 
Percentage 



0-25 minutes 



16(0.8) 



10(0.9) 



26-50 minutes 



24(1.5) 



17(1.1) 



More than 50 minutes 



46(1.8) 



57 (2.5) 



No information given 



15(1.0) 



17(15) 



The standard errors of the estimated pen entases appear in 
parentheses. It can be said with ^ pen enl i unlidence tor each 
population of interest that the value for tin* w hole population is within 
plus or minus two standard errors of the estimate tor the sample In 
comparing two estimates, one must use the standard error of the 
difference (see Procedural Appendix lot details) I'en entases mav 
not total I OH percent due to roinnlinj; enoi 

SOUKlT: National Assessment ot 1 dm .monal I'to^tess (NAM*), 
1*W2 Writing Assesstuenl 



Use of Computers 

Although many schools across the country have computers available to 
students, only a small percentage of the papers submitted for this study 
were typed: 6 percent at the fourth grade and 14 percent at the eighth grade. 
Students were not asked whether they had used a computer in working on 
their portfolio submissions. Instead, the use of computers was inferred from 
the product in the folder — if the paper was typed, then it was classified as 
having been the result of computer use. 

Choice of Topic and Types of Writing Activities 

For the past decade, theories in literacy education have emphasized the 
benefit of creating rich, realistic learning contexts in which students are 
active participants in the development of their reading and writing 
abilities. 1 * Process approaches to writing instruction also emphasize the 



,s )aj»j»ar, A ami Smith Hurke, M I , < W/vmy tin- 1 ttn^iui^' t emter (Newark !>!■ International (tending 
Association md Urbana. II National I ouncil ot leathers of I-'nglish, IWi) 
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active, meaning-creating aspects of writing. lh Under those approaches, 
teachers alternate between activities that require students to select their 
own topics, purposes, and audiences for writing and activities in which 
teachers (or other students) specify topics, purposes, and audiences. 17 The 
goal is to give students a wide range of experiences with writing. In school 
and beyond school, students will be asked to write for their own as well as 
for other people's purposes. Therefore, a central goal of writing programs 
is to enable students to be effective writers under both self-directed and 
authority-directed conditions. 

Eighty percent of the teachers who participated in this study completed 
the teacher questionnaire about the activities that generated their students' 
writing. Based on information gathered from teachers' responses to the 
questionnaire and students' letters, verv lew students at either fourth or 
eighth grade selected the topic of their portfolio papers (S percent and 
9 percent, respectively). 

We further analyzed the information teachers gave about their 
classroom writing activities, classifying them based on how specific the 
activities were and what sources of knowledge students were required 
to draw upon to complete the activities. This analysis yielded four main 
types of activities: general writing prompts, focused writing prompts, 
content reports, and integrated activities. "Prompts" were any topic, 
situation, stimulus, or assignmen . given to students to elicit a piece of 
writing. In keeping with recent theories about the importance of context in 
literacy learning, writing instruction and assessment experts maintain that 
an effective writing prompt (or instructional activity) should not only 
specify a topic for the writer, but a clear audience and purpose as well. ls 

This analysis was designee) to look for evidence that teachers' 
approaches to writing instruction were consistent with process writing 
approaches. Thus, NAHP specifically asked teachers to indicate whether 
any process strategies had been used such as free writing, peer discussion, 
drafting, or revising. Table 1 .4 summarizes the percentage of activities in 
each category. Some teachers did not respond to the questions about 
instructional activities. In total, 14 percent of the activ ities at grade 4 and 
13 percent at grade S were not described, ami thus are listed as unknown. 

'" 1 an>;rr, I A. iiml Ap|»k»hri\ AN./ #■ ■•«■ IVm/im v « »J|.ip ■ / Unit m ; \ ^tutlu /< ■<< 'n>r v - >t*ut i ii/nm/v 
(Urb.in.i, II N.ilion.iK oiim il ol I«m<Ih-iso| I n>;li *h, I'is'.'i 

'"draws I) II . IVrrfffix* fi'iiifirr- tttul t /iih/n u ,iM\."A il m In Ml I liiiuttt.inn 1 ihii .Hion.il 
Books. IW) 

" White, !■' M , /rw, hm^ mui A^r* mi v > \\ ntm ,• i s,n, | Mn i imh ( \ |. s li.i»s I'iiMisImms, I^Kii) 
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Table 1.4 

Types of Writing Activities 



NARRATIVE INFORMATIVE PERSUASIVE TOTAL 



Gr 4 Or 8 Qr 4 Gr 8 Gr4 Gr 8 Gr 4 Or 8 



General Pminpls i'bllO) 18(18 ) 27(15) 19(1.1) 19(47) 14 (17 ) 26(1.3) 19(1.1) 

Focused Prompts b{i)b) I (1 0) 7(0 8) 7(0 8) 9(2.8) 10 (1.2) 6(0.5) 7 (0.6) 

Content Reports 1(0?) 1(0.1) 4(0 5) 4(0 6) 2 (1.3) 2 (0.6) 2 (0.3) 3 (0.4) 

Integrated Activities r>fi(?1) 6?(?4) 49(1 9) 57(2.2) 60 (3.3) 63 (3.3) 52(1.6) 59(1.9) 

Unknown 12(11) 12(16) 15(12) 12(1.5) 11(17) 11(2.1) 14(0.9) 13(1.3) 

I'lie standard errors ol the estimated pen entases appear tn pa rent hoses. It can be said with l >5 percent 
confidence for each population of interest that the \ alue tor the whole population is within plus or 
minus two standard errors ol the estimate loi the sample In compaiin^ two estimates, one must use 
the standard error of the dilleten* e (see I'nu i-dural Append iv for details). Percentages may not total 
100 percent due to rounding; error 

SOURCK; National Assessment ol i durational Progress (\'AI I'). P> 1 »2 Writing Assessment 

As with the other types of analyses, the percent of exact agreement 
between readers was calculated for 30 percent of the papers. At the grade 4, 
the rate of exact agreement was 92 percent; at the grade 8, it was 88 percent. 

General Writing Prompts. Overall, 26 percent of the fourth-grade and 
19 percent of the eighth-grade activities could be classified as General 
Writing Prompts. In these types of activities, the teachers gave the students 
a general topic about which to write, but they did not focus the students' 
attention on any single aspect of the topic. Nor did the prompts make 
explicit to students an audience or purpose for their writing. Below are 
two examples of this type of activity. 

Write a stv/n/ s/on/ about this room, (fourth grade) 

Describe yourself mid your future, (eighth grade) 

Focused Writing Prompts. Overall, 6 percent of the fourth-grade and 
7 percent of the eighth-grade activities described by the teachers could 
be classified as Focused Writing Prompts. With these activities, teachers 
specified for students not only the topic and the task but an overall purpose. 
Sometimes activities in this category also specified an audience and criteria 
for effective writing. Below are two examples of this type of activity. 
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Since we live near the seashore, we have an appreciation of its beauty. Let's 
share a description of the seashore with a child in the Midwest who has never 
seen the ocean, (fourth grade) 

Select one of the seven topics on the board and write a letter to the local 
newspaper expressing your opinion, (eighth grade) 

Content Reports. Although we had asked for papers written for English 
or Language Arts classes, some students submitted papers on science or 
social studies topics, indicating the use of writing across the curriculum. 
Only 2 percent of the fourth-grade and 3 percent of the eighth-grade 
activities fit into this category. These activities required that students write 
papers reporting on information they learned from classwork as well as 
from outside sources, such as newspapers or reference books. Papers about 
historical figures or concepts in science are examples of this type of activity. 
Below are two examples. 

Research and write a report about the tropical rain forest. Use information 
front magazines, newspapers, and books, (fourth grade) 

Conduct library research about a famous Black American. Determine why this 
individual deserves a place in history, (eighth grade) 

Integrated Activities. The majority of the activities at both grade levels 
appeared to be part of multi-day, multi-stage, integrated activities, where 
teachers engaged students in a series of classroom activities around a central 
theme or text. Overall, 52 percent of the fourth-grade and 59 percent of 
the eighth-grade activities were classified as integrated. Below are two 
examples of this type of activity. 

Write a story about a dinosaur you created, giving a description and important 
facts about it (assignment given at the end of a unit on dinosaurs). ICIa^ 
discussion of ideas and descriptions; first version drafted and proofread; draft 
revised and final version produced.! (fourth grade) 

Write your life story/autobiography. {Elements of an autobiography were 
discussed in class. Students grouped in pairs and conducted interviews with 
each other. Students asked questions pertaining to their life history and event* 
Students exchanged notes and planned their autobiographies, with suggestions 
from their partners. They reviewed each other's first drafts and proofread their 
second drafts before a final version was produced.! (eighth grade) 
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Summary 



Although participants in this study came from different classrooms 
across the country and wrote on a wide variety of topics, the papers they 
submitted had some commonalities. Most of the papers we received were 
either informative or narrative pieces, written to an unspecified audience, in 
response to multi-stage, integrated classroom activities. The majority of the 
papers showed evidence that their writers had employed process strategies 
in producing them. Revision and prewriting were the most frequently used 
process strategies. In addition, the teachers reported that about half of the 
students spent more than 50 minutes on their papers. Lastly, few students 
chose the topic of their writings; the papers at both grades 4 and 8 varied 
greatly in length; and few papers were written on computer. 
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Evaluating Students' Portfolio Writing 



Introduction 

This chapter presents the scoring guides used to evaluate students' 
portfolio writing and presents the results of this evaluation. For each 
domain evaluated (narrative, informative, persuasive), the percentage of 
papers submitted at each level of the scoring guide is reported. Examples 
of students' papers at each level of the scoring guides are also presented. 



Narrative Writing 

This section presents the scoring guide used to evaluate students' narrative 
papers; the results of this evaluation for all of the fourth- and eighth-grade 
narrative papers submitted; and examples of students' papers at each level 
of the scoring guide. 
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The Narrative Scoring Guide. In reading and evaluating the narrative 
papers, the scoring guide development team focused on several key features 
of narrative writing. First, they loosely defined a story as a series of related 
events or happenings. Hence, the first level of the narrative scoring guide 
is not termed a "story," but an Event Description because only one event 
is described. 

The second feature the team saw as differentiating among the narrative 
papers was amount of development. The main difference between the 
second and third levels of the narrative guide is that, in a Basic Story, 
one aspect of the story is somewhat developed, whereas no aspects of an 
Undeveloped Story are presented in any detail. The difference between 
the third and fourth levels is that many of the events of an Extended Story 
are somewhat developed at the fourth level. At the fifth level, Developed 
Story, almost all of the events are described in detail. 

The third feature of narrative writing the team used to evaluate the 
papers was quality of development. Papers classified at the upper two 
levels, Developed Story and Elaborated Story, not only contained detailed 
episodes, but also included some source of tension or conflict (characters' 
goals, problems to be solved, mysteries to be unravelled). These two levels 
differ in the author's success in establishing and resolving the tension or 
conflict. While in a Developed Story tension is clearly (and often creatively) 
established, it is not completely resolved; in an Elaborated Story, the tension 
is both clearly established and completely resolved. 
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Figure 2.1 

Narrative Scoring Guide 



Describing a single event: 

1 Event Description. Paper is a list of sentences minimally related or a list of sentences that all 
describe a single event; or a description of a setting or character. 

Writing about a series of events: 

2 Undeveloped Story. Paper is a listing of related events. More than one event is described, but 
with few details about setting, characters, or the events. (Usually there is no more than one 
sentence telling about each event.) 

3 Basic Story. Paper describes a series of events, giving details (in at least two or three 
sentences) about some aspect of the story (the events, the characters' goals, or problems to 
be solved). But the story may be undeveloped or lack cohesion because of problems with 
syntax, sequencing, events missing. 

Writing about a sequence of episodes: 

4 Extended Story. Paper describes a sequence of episodes, including details about most story 
elements (i.e., setting, episodes, characters' goals, problems to be solved). But the stories 
are confusing or incomplete (i.e., at the end of the story the characters' goals are ignored or 
problems inadequately resolved; the beginning does not match the rest of the story; the plot is 
weak; the internal logic or plausibility of characters' actions is not maintained). 

5 Developed Story. Paper describes a sequence of episodes in which most of the story 
elements are clearly developed (i.e., setting, episodes, characters' goals, or problems to be 
solved) with a simple resolution of these goals or problems at the end. May have one or two 
problems, include too much detail, or the end may be inconsistent with the rest of the story. 
Or the story may contain one highly developed episode with subplots. 

6 Elaborated Story. Paper describes a sequence of episodes in which almost all story elements 
are well developed (i.e., setting, episodes, characters' goals, or problems to be solved). The 
resolution of the goals or problems at the end are elaborated. The events are presented and 
elaborated in a cohesive way. 



Results of the Evaluation. I ; igure 2.2 presents the percentage of narrative 
papers pt grades 4 and 8 at each performance level of the narrative scoring 
guide. At the fourth grade, 5 percent of the papers were classified as Event 
Descriptions, 47 percent as Undeveloped Stories, 36 percent as Basic Stories, 
10 percent as Extended Stories, and 1 percent as Developed Stories. No 
fourth-grade papers were classified as Elaborated Stories. 

As might be expected, more of the eighth-grade papers received higher 
ratings than did the fourth-grade papers. Two percent of the eighth-grade 
papers were rated as Event Descriptions, 21 percent as Undeveloped Stories, 36 
percent as Basic Stories, 29 percent as Extended Stories, 11 percent as Developed 
Stories, and 1 percent were classified as Elaborated Stories. 
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Figure 2.2a 



Results for Narrative Papers 




Level 1 Level 2 Level 3 Level 4 Level 5 Level 6 



Event Undeveloped Basic Extended Developed Elaborated 
Description Story Story Story Story Story 



The standard errors of the estimated percentages appear in parentheses. It can be said with 95 percent 
confidence for each population of interest that the value for the whole population is within plus or 
minus two standard errors of the* estimate for the sample. In comparing two estimates, one must use 
the standard error of the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error 

SOURCE: National Assessment of Educational Progress (NAHP), \992 Writing Assessment 
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Results for Narrative Papers 
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Level 2 Level 3 Level 4 Level 5 Level 6 



Event Undeveloped Basic 
Description Story Story 



Extended Developed Elaborated 
Story Story Story 



The standard errors of the estimated percentages appear in parentheses. It can be said with *>5 percent 
confidence for each population of interest that the value for the whole population is within plus or 
minus two standard errors of the estimate for the sample. In comparing two estimates, one must use 
the standard error of the difference (see Procedural Appendix for details). Percentages may not total 
1(H) percent due to rounding error. 

SOUUCK: National Assessment of Mutational Progress (NA1-P), W2 Writing Assessment 
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Examples of Narrative Papers 19 



Event Description (score of 1). Papers classified as V.vnU ntwipthm lell 
about one event. Basically, they say, "such and such happened." Hume of the 
papers in this category give details about the setting and so appear to be 
more elaborate stories. However, they end with a description of a single 
event, rather than a series of events. The paper below written by a fourth 
grader, is an example of a simple Event Description. 



^Ilal knA, rjljyKir^y^ \PJ lib* « " 



^oXa^jJSn . r 





"For more examples of students' writing, see Appendix 
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Undeveloped Story (score of 2). Tapers classified as Undeveloped Stories 
teil about a series of events. Basically; they say, "one day ihis happened, 
then something else happened, and then another thing happened." 
However, the events, as well as the setting and characters, are only briefly 
described. The writers give very few details about each ever.^ the story is 
a listing of related events. 

These stories are similar to a front-page newspaper report, where the 
basic facts of a story are reported (who, what, when, where) but where few 
details about why events happened are presented. For example, in the paper 
below, the fourth-grade writer uses one sentence to describe each event. 



TL ('/.si 

One -L com ^oh^ \ v \c L ov *U ca (- iuy 

H Ik: h.h-n-i t ) hat r , /"I /<V ^<?<V / */7 - Jl^^ to 
W'V.Jrw /..m/ fix; i jlxci :> \ - i^^t V cr y 5<^r*J ■ 

/J 0*4-, 

Wl^n 0-»f :">(..:./" Dm- <.|Ko'., I- a^oihj Coc /'-noc^ 
I I rjO /' / '<_> /'</• ,' k \ L\ C C 'I I »v C b O n cJ A'U c a }\t s f 



33 



BEST COPY AVAILABLE 41 



Basic Story (score of 3). In papers classified as Basic Stories, the writers 
go one step beyond a simple listing of related events. One aspect of the story 
(the events, the characters' goals, or the setting) is somewhat developed. 
However, these stories lack a sense of cohesion and completeness. Events 
may be presented out of sequence, some aspect of the story may be 
confusing due to problems with syntax, or a key event may be unclear. For 
example, in the paper below, the fourth-grade writer describes a series of 
events in his/her life as a pencil. Although two simple problems arise and 
are resolved, the ending is confusing — it seems to be a listing of loosely 
related events. 




W VJSL 

*zr -^er siJurst ■ TJjl -put nm- 
-/QoJ; mL<L -^i st)vi -pibnAjifL -bk&zflinci 

4 L 

-^cYHifiojHg. Jul ^.rJ J.o- 6d 
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ViIJl ! VJ.hjtm Si pM ajnJ nrup $LaJ 
.jJ: an^xi>L avid jJil/n /m ^i <ht#M 

^^'A^-'dL ttlunzp, ^Jitsb-- StJttsz^- 
j^llA ^thcck *uhjuszi JZcL^Jt-^L c^rzXJ^ 
svia&ty rrma^ JjUti dkttiLtf; dtlJl^^n^/^, 



35 



43 



Extended Story (score of 4). Extended Stories go beyond Basic Stories in 
that many of the events in these stories are elaborated to some degree. 
This degree of development gives a sense of a sequence of distinct story 
episodes. Details are given about the setting, the characters' goals, problems 
to be solved, and the key events. Yet, these stories may be somewhat 
incomplete in that the characters' goals may be left unresolved or the 
problem posed in the story's opening never solved. The ending may not 
match the beginning or the story's ending may be inconsistent with the 
internal logic established throughout the rest of the story. Or, as in the 
example below (written by an eighth grader), the story's plot may be simple 
and the character development basic. 

It is important to note that, while Extended Stories are not as elaborated 
or complex as are Developed Stories and Elaborated Stories, they are successful 
stories — all of the key story elements and events are clearly presented. 
They are the simplest type of complete story on this scale. 




One a$Mrooar\ oc^ £>ep*.2£>,\ c Wi X rr>od e 

En end A-lrm Qnd L hed a paptr doe. \c\YveAarq 
ata>v and uo«- mkd vo r^adi 

^oo X ea^Wd ox\ Sc\eoc\ Wore, ard 40 Id 
her Vo Cr.coe ai>d '• ..eic co_ ( og^v \<vx>.^v\C!r\ , 
vonen <iV>e. maoed, x ^xxxued n«.c ocwfVimc 
^CWoe., One '\\o\-\k\ NoLX^Mrc^, w ft -V\me <YX}CVvoei' 



tAC^ \^ (W*S >V.' kV \ J .j£tSU VScGSi'.' TV\en 

i ^ r >l \ \lw 1 1 til /V ' 
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X \d6 her"or\ £>v\o¥os> ar>d aev vo>y ^nz 
0,0V \cn and I <oe\ -v-r^e. buttons Cbc CSooe.nn?. 
X-V- UJQ^b UJ\Vte.<bxV r\de. T.Vc euer been or>, 
Or 9^c<Jd x £0^4 "experienced. UJn \am2.d\osa 
¥-\€^6. T^m, UJ£ V\\d A-be Vvorve cr\adS\oe \De.h\o>d 
Sotr? toshes , 

VXJ£ <bYac\*d ujaWs^ \o \clo^ am £cu-d 

Tiactn vue. ^AacVid c\3<no^ uJV>e.r^ uje. dou\di 0\c<s 
^cefo. IXX me\ a \\W\e. ^oov/ r\M>n<Ld Onns 

Wt yxjoR> Cu<V\\0^ cxca^nd V.\\e_ a \;v\\e 
We tela oS> AnoA R^vsm '^css uocxs 
ft'v/=> c\dxV dicer rVv^hbcr. Q\cvo <=^>ouj£d US 
UJnefe £)r\e \\0ed . Thm , ujc \aWed vbe>Sq 
vscea and ay^d ^er \V vV Voa^ oVaq \£ 
UJ£ douV^ s^-ajq u_)\-vn, \-\er a -feo^ da.^. 
SY\e os -\hc^ uoe dead ,coV <hr<L loqavs^ 

us> -yo v^e\p accord Voe. <naJ5£ and oOi+h 
-Vae_ Vs\6-=>. Thf^nexf dO-U, we- vVJa«\cd 
dv-anes, a nc\ . ;-vo.e. v;cyb. vue. ma^rty \neApe4 
^Ji-Vn Jo^fxx^ ,-Voe. qconqe-yi cog. v^atf^ vjerq ac-hs-Vv'c 

Thav Ctojo\ Ssv^e. •pokCNCfcs Oami -vo Q*.-Ysq and 
r>ec Ao roovj? Q Sbc Voc o.s.a. <ioe 

QQftoa. <oY>e tckmic ^ mci ^\oa^ excx^ evoked 
U^> LOfYdn ocs<l kxjsl \vXsc\. TVse^ ^joe. Vo\c\ ne.c 
-Vnav vv-nclcx <^<roo\d Os. a uJhvOo, ^ cec\, 

uu\vv« , OOd Hue ,<obe 2*0, Id , X que.c<=> uje. ^YnclW 

O0£S wl* T?uc\p>Vi> )0xxn.M ccAor?,. 

A'OG rcuoo\o+\or> . OWaa^I a,\ar^d -H\2. Vvroa frooS»oe. 
VxVxe.Tlne.rN aje. OSed -vrero \or ?^xl\ \rs cor 
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Developed Story (score of 5). Developed Stories describe a sequence of 
episodes in which almost all of the events and story elements are somewhat 
elaborated. Yet, one aspect of these stories is not well developed such as the 
ending, a crucial event, or an important character. In the example below 
(written by an eighth grader), each episode is somewhat developed, but so 
much happens that the characters are undeveloped. 



Or\c£ upon o iima them u£o a 

Couple, nonned Oa\i»"d Ond CavSU u)hO 

uxra barely rrOmeri . They uoent on 
Their hcnek)rrccn -to a -ferebt oalled 
Silvier Oc&K ,Thsy u*>»t he the fcve>5t 
fcr CQmpmg because. -ih&) Thcucrrf. i t uxi5 
{prg -to be. -fttn . ' J 

. They rented a oabm HItqu ueera 
amcus -fc ftnao Lcmt mc& in tHo uxccfo 
becnuse they Keptcn beannq n&is^o 
mcori5 and gitx)rb . LUhen -tiiai uient 
■torther into *\r& urate -they i^urd a 
ttwe -The naseo cnm^ T?cm inside 
+ne. axv£ ."They bucfer orcl lacloc. 

They ujot^ cpflicQ scored , tut thti ladab 
Kustord 5Qid; l L5nt lcoitl] , its n^hmq 

-fc be. ccaied crfH J ^ 

They Loore* etui curious -to qo 

moicfe -the. cq^l -tte rccK? from -tte 
+op -fei | on -tine, ontrarm ore! Th^u 
ufcre. -trapped insi^TTFieu ecr^arr^d 
tecauf^ ^ y gpt saarcd. fit first 
they didat r\nao ujhat -to do, but -fheu 
sad; nau -float -they u&rfc stucK in5ibfe, 
Vt*x\ ahculd eee ujhat Tht rg ux^ 
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rrottim the harnb)e mi'ee . 

uOhen -tVey ooenC -farther +hey 
Vtayd a gun shptr .T-ir reverberated 
thCqghcat the cave .The, gun ecund 
finally stepped, ftP+er the gun shcf , 
they V^Cttd a oca pel UrSe acn^one. 
uxo Cheung "fcm, Mo one uoao -there. 
Suddenly -freij heard nDisee> teKnd+inem. 
lOhen -ffWj -furred orcund, tVere o~o<b 
ol b>g ratTThe rat ran m-front: o-P-theno, 
"They Kept an icalh> 03 and uniting, 
"They wont -farther and -farther into 

th£ CQven^ey Weyft: on Rearing the rate 
Out the -furtner they ujentj ~rne more. 
n^e, t£urcted eenreore- ye\\iYg for 

UOhen iVeoj g^rto -we rrwcfcUe, of" 
thd -VKy (cure* -i-hre*e paths* ."They 

(^a\vz.ed tW^ -tn<e. oCtse. gp^i ng 
from -tV^L pcfrh \r\ -trie nn\cidi\e, 

"\Ve\e uoab arO o\c5 v.aocc*eo door 

b\ocVS\\rQ *VVn& uocx^ -forn u3a\On -VY\C 
noVs£, U3Q5 cor^\'nCj*"The.v^ ev^erea \\l 
and a\ah cf xrt^ecfe cya^^ a\t* 
Tbey opt i3a^r^ arC starts -Vo ecf^arry 
~Vh6^ Souo renews j vote , bate ard \i-?cad5 
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QOm'vr^ fibm -tbecyenirg*The bate dortec) 
-to Pjy arajrxjdVem oro the rate ucerc. 

ard Oirto.'lhev) Ve^d ^Ve crurchina 
£p rcscdres underneath ihaV^ fet . U)ber\ 
Ctey ran -to opt QujQu ficm them she -fen 
into K>\e. 

5k hut Inee OrrA Vjut net todly , 
tOren fco\<ed arcurd ^ he eoicarron 
daao\ there ,-Hb lea uocti dmppcij ohe 
-ftjyiic Irelp him bat t>V~e <rx\ldnt hecau^e 
-Rfe cinenn on his teg loo^ eo hc£wu.5he 
called Chvd -b help her, ^ ^ 4 r id -to 
go irrtothfe hotefTVe hole uuoi? *hm,tut 
fe eQpezed -thrown , uhen he gpt cJcuon 
-ther^" he> ncfed -fine -hap ta^a ton and 
chain, life O'crn a prveon * He Qjco curias 
+0 Kneuj uJKy * Ha uuas hurt, sG Cbva 
fax a big rcaA and tehe chain, 
the man ccuidrfe L oal ft * Vte'd ton there 
fer ex c3au / rfe -WW JDava Vto rovrc; ujcd 
Charlie Smith and \^ escaped fibm -the. 
near Jy pn5cn#Tbe&e scored Gave cmd 
to^yjloui- -th^y .cruidnt Yvm there, 

-to die - 

. "They -hrgj fo -ftrd a ujQy CO -(hat 
+hey could get cut oP the cave, Dew id 
^3Xo \ight CDmi"nq ait firm behind a 
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rocK,He Idd Ojiuj ona Clwlic that he 
hod fcurd a u_au cat* So Dav«c\ onrr^j 
Charlie to the e^rtr tloat loas behind 
the nx)A- OjvicI cw<\ Cbrsy pusbsfrhe rccK 

tcr a hoax te%e it rmiCCf , 

LChen they cpr oaToP the cave t|~cy 
itenT \c -vnc_ cabin . 

TY^vo Char he star-ted teti 
'W^m hib ^rtoiq , He. told them thaC he 
had escaped ncyr\ ",ail arf_\ that the 
)ql\ I to05 ovidr On the other ei'do rf" thd 
cave. , iold them "that he. ecociced uji'th 
CArohrer Pnerd, cui he fhord bad 
diod '.a Che. tunnel Decause he 
Si'cK. He cdc^ that he nrDcte a hole gspd- 
&3^.&^m& ard uohen he 90h mlafbe. 

O^O Chain, he aoUdht opt up, LOhen 
he heard David, arc* Paisy in the cave, 
he ftyedthe gun ha e>toie from (X Qpa»d 
to c^h -their otlenfen^afe u^hen Daisy 

Pfter hearing the. e?\cry, Daie>3 
excused hersei-r 4o no to the fcahhrran 
she caii&Dltho.oeA'ce .{?brry~1"he JoodrGDm. 
She cares boc A Qnd ^efar^d^nc£h\cg 
hopperect In aixxrh pPteen nn mutes, 
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Hn& poWce ^nccHed Chtha. door. 

"The pshce. said Char I re iv#> really 
6ob Creoier, 4Ve rotaricus horeyvn&n 
ccup\e senai. Kilmer. Sab br>d wTied 
+hre^ ccupte at 6>iluer CreeJ^fcv^t 
fn tine tot ulcers. Davd and Dbi'sy cpt 
a threes thxoard dcilar retoard , il'ao 
•Vhey can go -to tW>aM u3V^ef& +hey dent 
fhmK -Vhey ? l 1 hear any ^°cr^, otrang^ 
noises, or toill-they,,. ^ 
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Elaborated Story (score of 6). Few papers were considered to be Elaborated 
Stories. To be classified as elaborated, stories had to present a sequence of 
episodes in which almost all of the events and story elements were well 
developed. Goals or problems introduced in the beginning were well 
resolved by the end, characters' motives were well developed, and the entire 
story was a cohesive, unified whole. In the example below, an eighth-grader 
writes a compelling story about a football game. In it, the writer effectively 
presents each episode, leading to the over-time ending. 

English 

It was a brisk Monday night. I had just come back from 
CCD, and was getting ready to watch the game, I turned on 
channel seven and sat down. The pregame shew was just about 
to start, so I went to the bathroom* When I came back the 
announcers were talking about the weather and hew cold it would 
be in Chicago • The Jets were not used to this frosty atmosphere. 

The Jets won the coin toss and elected to recieve. Terence 
Ma this, of the Jets, was standing at the twenty yard line, waitino 
for Kevin Butler to boot the ball at him. Mathis caught the ball 
and downed it in the endzone. The Jets scored a touchdown on 
their opening drive. 

For three quarters, the two teams beat on each other with 
a vencance. The Jets were wining 21-14 late in the fourth quarter 
with five minutes remaining. The Jets Pat Leahy kicked off and 
the Bears started their critical drive on the twenty yarline. 
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The Bears quarterback , Jim Haurbaugh called hike, and 
the center snapped the ball. Harbaugh dropped back in the pocket 
and saw the WR, Waddle of the Bears, and hit him with a thirty 
yard bomb. The next play, the quarterback called a handoff to 
Neal Anderson, the Bears running back. He jetted down field like 
a bandit being chased by a cop. Suddenly the Bears were deep 
into Het Territory. The Bears Fans were going wild in the 
stands. They were already in field goal range, but a touchdown 
would only be valid. They were on the Jets five yard line with 
0.59 seconds remaining and no timeouts. Harbaugh called hike and 
handed off to Anderson, he was stuffed by the men in green, a 
loss of two. Second dcwn and goal and Harbaugh throws incomplete. 
He throws incomplete one final time, and the Bears were faced 
with a fourth dcwn and seven situation, They had to go for the 
touchdown. Harbaugh a quaterback sneak and was instantly crushed 
by a swarm of Jets led by Jeff Lageman. It appeared the Jets 
had won the game. The Jets would take over on the Bear seven yard 
line. 

Bruce CDs let coach of the Jets, elected to stay with the ball 
instead of punting with 21 seconds left. 

The Jets handed off twice successfully with ten seconds reraing. 
Then Blair Thomas recived a handoff from the Jets quarterback 
O.Brien, he had never fumbled in his life. Now he had fumbled 
once. The Bears went for the ball that was in his hand like it 
was a bar of gold. The stadium was hoing to erupt. The Jets 
were in shock, I was in Shock. Then I said to nyself what do I 
have to worry about. The chances of them scoring a touchdown 
were one in a million. The Bears had the ball with 3 seconds 
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left and one play. It was do or die for the Bears. Harbaugh 
called hike, I wasn't nervous not even for one second, until 
I saw the Bear runino back, Anderson, charge down field. I 
screamed at the television cover Anderson, cover Anderson! Harbaugh 
must have heard me, because that exact second, he threw the ball 
right into Anderson's hands in the endzone. I was staring at 
the television in disbelief. Butler of the Bears tacked on the 
extra point. Ihe game was tied at 21. The game had been reborn. 
We would have overt ime. It was 1:1b in the morning, there was no 
way I could sJeep now. 

The Jets won the coin toss and elected to recieve. Before 
I could blink, the Jets wore on the Bear twenty yard line. The 
Jets sent out the f LeldgoaJ unit. I thought this game was in 
the bag. The snap came dewn, Leahy kicked, aivi it was wide. Now 
I was mad, oppurtunity knocked at the Jets door but the never 
answered. 

The Bears would take over on their own fifthteen yardline. 
As the tension built, this contest seemed it would never end. I 
was thinking about the hell I would go through in school tommorow 
if the Jets had dropped this game. There were 1:05 seconds redlining 
in overture. I was proying for an interception. Ihe Bears did 
not want a fieldgoal. Harbaugh fell back in the pocket and hit 
Wendell Davis, WR of the Bears in the endzone. The Bears had won. 
I couldn't believe it. I almost started to cry. They v/ere so 
close, but never won. I will never forget that September 23-24, 
on a frosty. Monday night. 
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Informative Writing 



The Informative Scoring Guide* In reading and evaluating the 
informative papers, the scoring guide development team focused on 
several key features of informative writing. First, they loosely defined 
informative writing as the presentation of information and ideas for the 
purpose of informing an audience. Further, in the process of presenting 
information, the writer establishes relationships between pieces of 
information and /or ideas. The papers were then classified according to 
how well the writers had succeeded in establishing relationships and 
according to how well they presented the information to a particular 
audience for a specific purpose. 

The differences between levels one through four are the degree to 
which tho writers established relationships between the pieces of 
information in their papers. The difference between levels five and six 
is the degree to which the writers conveyed a sense of audience and 
purpose. This was often accomplished through the use of an overt type 
of organizational structure. 
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Informative Scoring Ciuide 



Witting about a topic 

1 Lilting. Paper lists piet.es of information or ideas all on the same topic, but does not relate or 
clearly connect these pieces of information to each other A range of information or ideas may 
be presented 

2 Attimptid Discussion. Paper includes several pieces of information and some range of 
information. The information or ideas are now related. In pari of the paper, some of the 
information is minimally related (in a sentence or two), but relationships may not fully be 
established because ideas are incomplete or undeveloped (the amount of explanation and 
details is limited). 

Writing a theme: 

3 Undeveloped Discussion. Paper includes a broad range of information or ideas and some of 
the ideas or pieces of information are related The relationships are somewhat established, 
(in several sentences) but not completely The ideas are confused, contradictory, out of 
sequence, illogical, or undeveloped 

4 Discussion. Paper includes a broad range of information or ideas and, in at least one section, 
clearly relates tho ideas or information using devices (such as temporal order, classification, 
comparison/contrast, cause and effect, problem/solution, goals/resolutions, predictions, 
speculations, suppositions, drawing conclusion, point of view, ranking by importance, 
exemplification, illustration, definition) 

Wilting a thosis 

5 Developed Discussion. Paper includes a broad range of information or ideas and 
establishes moio lhan one kind of relationship using rhetorical devices, such as those 
listed above Infomiation. ideas and relationships are well developed, with explanations 
and supporting details Paragraphs are well formed, but the paper lacks an overriding 
sense of purpose and cohesion 

6 Elaborated Discussion. Paper includes a broad range of information or ideas and 
establishes more than one kind of relationship using rhetorical devices, such as those 
listed above Inhumation, ideas and relationships are explained and supported. The paper 
has a coherent sense of pnipnso and audience It demonstrates a mastery of the conventions 
of written English (yiammai. usage, mechanics) and employs a clear and effective 
organizational strucliiio 



Results of the Evaluation, ligure 2.4 presents the percentage of 
informative papers at grades 4 and 8 at each performance level of the 
informative scoring guide. At the fourth grade, 2 ( > percent of the papers 
were classified as Listings, 44 percent as Attempted Discussions, 19 percent as 
Undeveloped Discussions, H percent as Discussions, and 1 percent as Partially 
Developed Discussions. None of the fourth-graders submitted informative 
papers that could be classified as Dcvclopcil Discussions, 

As in the case of narrative papers, more of the eighth-grade papers 
received higher ratings than did the fourth-grade papers. Nine percent of 
the papers were classified as / i^tin^, M percent as Attempted Discussions, 
34 percent as Undeveloped P/m uss/tuis l l > percent its / )/w unions, 4 percent as 
Partially Developed Dt^ //ss/ ( >//s lew nl the eighth grade papers were 
classified as Developed Disi u^toiv* 
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Results for Informative Papers 
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Figure 2.4b 

Results for Informative Papers 
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Examples of Informative Papers 



Listing (score of 1). In the first category, Listing, the writer presents pieces 
of information or ideas all on the same topic. While the papers may contain 
a range of information about the topics, no attempt is made to relate the 
ideas or information. For example, in the paper below, a fourth grader 
writes about monkeys learning to jump from trees and about blowing a 
bubble for the first time, all under the title "Finally Popped." 
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Attempted Discussion (score of 2). As with papers classified as Listings, 
Attempted Discussions present a range of information or ideas about a topic, 
but they go beyond Listings because some attempt is made to establish 
relationships between the pieces of information or ideas. However, these 
relationships are not clearly established. The ideas or information may be 
incomplete or undeveloped. 

For example, in the paper below, the fourth-grade writer presents a 
range of information about things to do and see in Louisiana by identifying 
a feature (i.e., attractions) and then listing examples (riverboat tours and 
swamp tours). Yet, these examples are only mentioned and are not 
developed or organized into a coherent discussion. 
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Undeveloped Discussion (score of 3). Papers classified as Undeveloped 
Discussions go beyond Attempted Discussions in that the attempt to establish 
relationships between the ideas or information is more successful. Clear 
connections are made between information or ideas in at least one part of 
the paper. However, the information and ideas are not well developed. They 
may be confused, contradictory, out of sequence, illogical, or undeveloped. 

For example, in the paper below (written by an eighth grader), the 
writer introduces him or herself by describing things she or he likes and 
does not like. Information is not developed or elaborated. 



~ < -f r>\ ^/r^v^X l-Vt W pk'M ^"d r 

' v, -.fO.*"^ .■ -i '\ v. ^\txu&> bc»S* bcl 1 e-t^p Xu.o{ 



. r. - J : 5 ; - ,v v ,r : . iL'cr 



Ki i, / 



BEST COPY AVAILABLE 



52 

GO 



Discussion (score of 4). Discussions are more complex than Attempted 
Discussions or Undeveloped Discussions because, in at least one section, the 
writers clearly relate the ideas or information. A signal of this level of 
development is the use of rhetorical devices (such as temporal order, 
classification, definition, comparison/contrast, cause and effect, problem/ 
solution, goals/resolutions, predictions, speculations, drawing conclusions, 
point of view, ranking by importance, exemplification) to relate some of 
the information and ideas presented. However, these papers do not take 
the next step and relate all of the ideas or information presented to an 
overarching purpose. Thus, while these papers retain their focus on the 
main topic being addressed, they also seem to skip from subtopic 
to subtopic. 

For example, in the paper below, the fourth-grade writer compares and 
contrasts cars and airplanes. While this analysis of cars and airplanes is 
clearly written, it appears to be written out of context. Without an overall 
purpose or audience for the information presented, the features upon which 
the writer selected to base his or her comparison appear arbitrary. 



There can be both comparisons and contrasts between 
airplanes and cars. They are alike in several ways. They both are forms of 
transportation. The two use petroleum to run their engines^and they can 
both transport more then one person. Airplanes and cars ride on rubber 
tires. A person who drives a car and one who flies an airplan* needs a 
license to drive or fly. 

Airplanes and cars are different in a lot of ways. An airplane 
flies in the air while the car rides on the ground. Airplanes can carry 
hundreos of people while the car can carry only eight. Airplanes are 
manufactured by only a few companies, but cars have many manufacturing 
companies. Airplanes travel at high speeds, but cars travel at lower 
speeds. Airplanes carry cargo as well as people, but cars carry people as 
well as their belongings. When airplanes are not being used, they are 
stored in hangers and cars are put in garages. 

Airplanes and cars are alike in many ways. They also have a 
lot of things that make them different. 
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Developed Discussion (score of 5). In Dm'hfWti Discussions, information 
and relationships are established and well developed, with explanations 
and supporting details. The paragraphs tend to be unified and well formed. 
However, the paper lacks an overriding sense of purpose, audience, and 
cohesion. The writers of these papers present a wide range of information 
on a topic, organize this information clearly, develop most of the aspects of 
this topic, yet do not create a context for their discussion that envisions a 
wider communicative purpose. 

For example, the eighth-grade writer of the paper below presents 
several examples about the theme of The Diary of Anne Frank. However, the 
paper lacks a sense of purpose and audience. The introduction is brief and 
there is no conclusion. What results is a series of well-developed examples 
rather than a discussion or theme. 
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Elaborated Discussion (score of 6K For papers to be considered Elaborated 
Discussions they had to contain all the elements of the previous category, 
and also present a coherent sense of purpose and audience. A signal of this 
level of writing is the overt use of organizational structure and excellent 
command of the conventions of written English. In the example below, the 
eighth-grade writer is able to connect several well-developed explanations 
of the character of Squealer to broader themes of Animal Farm, 
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Persuasive Writing 



The Persuasive Scoring Guide. In reading and evaluating the persuasive 
papers, the scoring guide development team focused on several key features 
of persuasive discourse: stating an opinion or position, supporting one's 
opinion with reasons and /or explanation, and appropriately addressing 
one's audience. Thus, the 114 fourth-grade and 410 eighth-grade persuasive 
papers submitted by students in 1992 were placed along a continuum 
of persuasive complexity, ranging from opinion to argument to 
elaborated argument. 



Figure 2.5 

Persuasive Scoring Guide 



Writing about an opinion: 

1 Opinion. Paper is a statement of opinion, but no reasons are given to support the opinion, or 
the reasons given are inconsistent or unrelated to the opinion. 

2 Extended Opinion. Paper states opinion and gives reasons to support the opinion, but the 
reasons are not explained or the explanations given are incoherent or confusing. 

Attempting to present an argument: 

3 Elaborated Opinion. Paper states opinion and gives reasons to support the opinion, plus 
attempts to develop the opinion with further explanation. However, the explanations given are 
not developed. These reasons may include benefits or positive outcomes that will result from 
the desired action or position. These papers may also contain a brief reference to the opposite 
point of view. 

4 Argument. Paper states opinion, gives reasons to support the opinion, plus explanations, with 
at least one explanation developed through the use of devices (such as personal experience, 
exemplification, sequence of events, cause and effect, comparison/contrast, classification, 
problem/solution, point of view, drawing conclusions). However, the argument is weak or 
unconvincing because the development of the reasons is thin, vague, illogical, inconsistent, 
repetitive, or disjointed. It may contain a brief summary of the opposite point of view. 

Presenting an argument: 

5 Developed Argument. Paper states opinion and reasons to support the opinion. It also 
presents several clearly developed explanations in support of the argument (through the use of 
devices such as those listed above). It also demonstrates an awareness of audience through 
the use of voice and/or selection of supporting details. It may contain a summary of the 
opposite point of view. 

6 Elaborated Argument. Paper states opinion and reasons to support the opinion. It also 
presents well-developed explanations in support of the argument. It demonstrates an 
awareness of audience through the use of voice and/or selection of effective supporting 
details. It may contain a summary and refutation of the opposite point of view. 
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Results of the Evaluation. Figure 2.6 presents the percentage of 
persuasive papers at grades 4 and 8 at each level of the persuasive scoring 
guide. Please note that only 195 of the papers submitted by fourth graders 
were persuasive, so that the percentages for the fourth grade should be 
interpreted with caution. 

At the fourth grade, 9 percent of the papers were classified as Opinions, 
66 percent as Extended Opinions, 23 percent as Elaborated Opinions, 2 percent 
as Arguments, and 1 percent were classified as Developed Arguments. None 
of the fourth-grade persuasive portfolio writing was classified as an 
Elaborated Argument. 

At the eighth grade, 3 percent of the papers were classified as Opinions, 
33 percent as Extended Opinions, 38 percent as Elaborated Opinions, 23 percent 
as Arguments, 3 percent as Developed Arguments, and 1 percent were 
classified as Elaborated Arguments. 
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Figure 2.6a 

Results for Persuasive Papers 
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Figure 2.6b 

Results for Persuasive Papers 
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the standard error of the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 Writing Assessment 
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Examples of Persuasive Papers 



Opinion (score of 1). In the first type of persuasive writing, Opinions, the 
writers assert opinions, but do not develop or explain these opinions in any 
detail. Sometimes they give reasons to support their opinion, but these 
reasons are unrelated to the opinion or contradict one another. For example, 
the paper below, written by an eighth grader, states an opinion about how 
one should behave when attending a school activity and gives several 
examples of appropriate behavior, but never explains why one should 
follow the advice given. 
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Extended Opinion (score of 2). Extended Opinions include statements of 
\ opinion and reasons to support the opinion. However, the reasons are only 

\ briefly presented or the explanations are confusing. 

For example, the paper below, written by a fourth grader, states an 
opinion ("Please stop killing whales.") and lists several reasons in support 
of this opinion ("They will become endangered." "It is not worth it."). 
However, none of these reasons are developed. The letter is more of a plea 
than a persuasive piece. 
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Elaborated Opinion (score of 3). Elaborated Opinions include opinion 
statements and clear reasons to support the opinions. They also contain 
attempts to develop opinions with further explanation. However, the 
explanations given are not developed or elaborated. These papers may 
also contain implicit references to an opposing point of view opposite the 
writer's own. For example, the eighth-grade writer of the paper below states 
an opinion ("No homework please!") and gives reasons to support this 
opinion. However, the reasons are only briefly elaborated. 
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Argument (score of 4). In Arguments, writers state their opinions 
with reasons to support those opinions. They also include at least one 
explanation that is well developed. Rhetorical devices (such as cause and 
effect, comparison/contrast, problem/solution, and classification) may je 
used to develop the explanation. These papers may also contain brief 
summaries of the opposite point of view. 

For example, in the paper below, the eighth-grade writer presents a 
clear opinion, with elaborated reasons to support the opinion. This writer 
uses cause and effect to develop his/her argument and organizes the 
argument into three sections, based on those who would be adversely 
affected by mandatory homework for students. 



Dear Pr 1 nc i pa 1 , 



I have b'-i-n ; i. f u rnn«i ! ha ' > nil *><;..■: I i h t ■ ■ ha . e \ he 
teachers issue two hours of homework se.rn da> > a week for 
the students. I am opposed to this issue . My r ea sons to 
support my opinion are t he teachers, parfits , and i tie 
students. — — 
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issue homework every nsght. then tne> 
to grade, which w i 1 I take awa> their 
huuld also ha\e extra planning to 

d 



My f irs t reason is 
to where they have to 
will have more papers 
extra time. The teachers 

do. and they would go faster in the book because there wou 
be an ass l gnment e \ ery n l »jn t . The teac h»-r s would also have 
stress from all the pape r s , p 1 ann l nvj . and the had grades . 
Which would make them take more days off and more subs would 
be needed . 



Sfr ftnnH 1 \ . the parents would be affected because all the 
homework would take away the students from the famil> due to 
all t he homework . The pa ren t s wou I d alsu suffer with stress 
from helping the students with ail the home worn. 



Ij j st che students would suffer the m-.- 
(he homework. The homework wuuld « aiisc i 
/a 1 _ot of stress. When snuii n; ■ h.:M .» i r » 
To drop-out ar/i with thi< .me.-d sir-'s-» t 
would increase, [he druj-.iut r;ite wnuid 
on the principal tin- j-tui!ej,:'> <(..■; 

f rom the a tided |inr,in*i m. \ \ ' hi ' u..< t . 
their time doin^ hnmew«>r[ t ! - ■ - : 

there would be [m t line In m 1 
time would suffer Suflw a I .u In 
It l me for a few da t »*s t ban In- 
take it easy, if all i h e i r 
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■< .HI.." if M. 
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t i me was sp 
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I he st udent s f re 
made some extra 
t l me to relax, 
nt on homework . 



n co ne 1 u s ion, I 
tin 
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Developed Argument (score of 5). Developed Arguments include clear 
opinion statements, with reasons to support the opinions and developed 
explanations. These papers also show an awareness of audience through the 
use of voice and /or the selection of effective supporting details and may 
have a summary of the opposite point of view. In the example below, an 
eighth-grader's first draft of an essay about the negative influences of 
Nintendo video games, the student discusses each point of his/her 
argument in detail, including references to why children find Nintendo 
appealing. (Side note: The underlined words in this example were from 
a vocabulary list the student was directed to make use of when writing 
this paper.) 



The Con ' s of N intendo Games 
society, today, N intendo games are unfavorable 
influences on ^ild^^. Vhile these ^ tnes mayte a child's 
dream, it ^Fs~~a^ parent *s nightmare. N intendo games are 
negative influences on children because they coerce children 
-/not to do t he i r homework . promote violence, and cause 
(^children not to take part in other activities. Fina 1 1 y , ■ candidly 



being a negative dominion these games cause children not to ^1 
do homework . 

Nintendo games are corrupting children because they 
cause a distraction from accomplishing their homework . The 
games cause the child to play Nintendo more than he does 
homework, which will therefore aTTe^t^his education. To 
chi ldren^ these games are more amusing than homework and hence . 
will cause them to play Nintendo! not finishing their r*^ * 

homework./ Instead of learning how to add and subtract the 'f 

ix f 

ich will /' ' / 



child will learn how to kill imaginary characters, wh 
no t be he 1 pf ul in life. These games are just like candy 



lotbe helpful in life. These games are just like candy, r 
<«fhich is a duress . Once a person eats a piece of candv he \* r ^ l 



uiite d peisun eaia a piece ui cdnuv ne ' t 

can not stop, just like when d person plavs Nintendo. ^ i 

Causing a distraction, the games, will make the child think." \ \.J 

' ^ V. 

? ~ A ^^/f Have to hurry up, so I can play 2<?lda, which us a garni- / h . 

■ killing trolls!" This causes the child to do his homework but Y ,\ 
not really think about it. Finally, by not doing homework 
the child will ruin his education and become v l o l i?nl . 
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Promoting violence, these games are adverse influences 

on children. By using famous people, the games promote/ 
H - O 

violence and also, these celebrities are used to bolster the 
them. Nintendo games advocate brutality by using an arsenal 
of weapons to kill peopl e and show that a person gets three 
lives even though in real life, a person really gets one 
chance to get it right. Rubbing off on the children, who 
play these games, the violence will affect their behavior 
drastically. They will become more brutal and violent and 
consequently will turn into bel 1 icose people. By using. a 
cartoon character, Bart Simpson, in the game " Simpsons verse 
The Aliens," the game promotes violence by showing Bart jump 



out a window on a skateboard and live whereas in real life a 




person would die instantaneously. M ^jtr 7 ^-" 5 v ^ a -i Nintendo n- 
games promote violence bv using famous people and causes a ; 
distraction to participate in other activities. 

""ffli'rdly , Nintendo games cause a child to / o > nT^ s j)l a ^ these 
games while the child does not associate with his parents or 
participate in different activities. N intendo games 
manipulate the child to keep playing evenjj^ough his parents 
want to talk with thu child. This voutd* prerbablr cause a 
separated family because there is no communication between 
the parent and thii child. Also, these games will cause the 
chi 1 dJ^K becomt; fat and have muscle at rophy awry because he 
doesn't Participate in .iny other activities. The fattening 
of thtr ch ild will be attributed to these nightmares because 
the child just sits in front of the T.V., does not 
participate in sports, or go outside when there is beautiful 
weather. Finally; Nintendo games cause the child not to 
perform in/other, d lurna 1 activities. 

F inal 1 y , by* a &a rent not letting their sibling play 
Nintendo games, Wiey would probably be stopping all these 
torrible event 4 to happen. By the pa rents not wan ting their 
h 1 Id to become fat, participate in other activities, have a 
bad education, and become violent they should not give him 

his "brain killer." Playing in recreational sports, having 
designated reading hours, and by helping the child with his 
homework the problem of him playing these games too much will 
vanish. Finally, If pa rents do not wish for their children 
to have a bad future^ the parents must say," NO" to Nintendo 
games . 
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Elaborated Argument (score of 6). Papers at the highest level of 
persuasive writing contained opinion statements, reasons to support the 
opinion, along with well-developed explanations of these reasons. Also, 
through the use of voice and/or the selection of supporting details, these 
papers demonstrate a degree of audience awareness not found at the other 
levels. They may contain a summary and refutation of the opposite point 
of view. As the paper below illustrates, writing at this level has a unity, 
cohesiveness, and voice that contributes to its effectiveness. 
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Summary 



The results of this study indicate that, for the most part, students' narrative 
writing at the fourth grade was still very rudimentary — most students 
seemed able to describe an event or to write about a series of events, but 
few could write about a sequence of episodes. More than half of the 
narratives selected as examples of fourth graders' best classroom writing 
(52 percent) were either descriptions of events or listings of related events. 
And while one-third of the narrative papers were classified as basic stories, 
only 11 percent of the narratives contained some development of plot 
or characters. 

Of the eighth-graders' narrative papers selected as examples of their 
best classroom writing, fewer were rated as undeveloped and more were 
found to be better developed compared to the fourth-grade submissions. 
Only 23 percent of the students submitted papers considered to be event 
descriptions or undeveloped stories. As with the fourth graders, 36 percent 
of the eighth graders' stories were rated as basic. However, 41 percent of 
the eighth-grade narrative portfolio papers reached the higher levels of 
the scoring guide — demonstrating that these students could write about 
sequences of episodes rather than just an event description or series 
of events. 

None of the informative papers submitted at either the fourth or 
eighth grades as examples of students' best classroom writing received the 
highest rating — Developed Discussion. To reach this level, students had to 
demonstrate the ability to manage a broad range of information or ideas 
through effective development and organization, for a specific purpose 
or audience. The higher levels of each of the scoring guides were designed 
to represent the ideal of advanced writing and the goals of many 
writing curriculums. 

The majority of fourth-grade informative portfolio pieces (73 percent) 
represented basic informative writing — either a listing of information or an 
attempt at a discussion. At this level, students were writing about a topic. 
Twenty-seven percent of fourth graders' informative portfolio submissions 
reached the middle levels, where students were trying to write about a 
theme {Undeveloped Discussion) or were successful in writing about a theme 
(Discussion). Only 1 percent of the papers reached the upper level — 
writing a thesis. 

By eighth grade, only 43 percent of the papers submitted were simple 
listings of information or attempts at discussion. The majority of the papers 
(53 percent) were attempts to write about a theme (Undeveloped Discussion) 
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or were successful at writing about a theme (Discussion). However, only 
4 percent reached the upper level of writing a thesis. 

Relatively few of the portfolio papers submitted as examples of 
students' best classroom-based writing could be classified as persuasive. 
Only 4 percent of the papers submitted by fourth graders were considered 
persuasive and only 9 percent of the eighth-grade papers were coded as 
persuasive. At the fourth grade, three-quarters of students' persuasive 
portfolio papers represented various ways of writing about an opinion; 
one-quarter made attempts at presenting an argument; and only 1 percent 
contained enough discussion of the opinion to be considered a presentation 
of an argument. The majority of the fourth-grade persuasive writing 
(66 percent) contained a statement of an opinion and reasons to support 
the opinion, but no further discussion. 

By eighth grade, 61 percent of the persuasive portfolio papers were 
attempts at argumentation, but only 4 percent succeeded in presenting 
an argument. And, while few eighth graders submitted simple opinion 
statements, 33 percent of the papers were Extended Opinions. 
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Part II 



The Best of Students' Portfolio Writing 



Introduction 

Due to the unique nature of NAEP assessments, the lack of a common 
writing context or task across students, and the great variety of writing 
submitted, it was not possible to have readers evaluate students' portfolios 
on a common scale. Students' portfolios were too different and their 
classroom contexts too dissimilar to permit an informed rating of whole 
portfolios. Instead, students' best narrative and informative pieces from 
among their portfolio submissions were selected for further analysis. 20 

Procedures 

If an individual student's portfolio contained examples of both narrative 
and informative writing, then the analysis included a best narrative and a 
best informative piece according to the evaluative scores (see Chapter Two). 

*' See Appendix C for a discussion of the various npprn.n hes explored in designing the annh sis ot 
students' portfolios 
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When a student sent in examples from only one domain, then of course, 
only the best piece for that domain was further analyzed. If a student sent in 
two narrative pieces, and both received the same evaluative score, then one 
was selected at random as the "best" piece. 

Identifying students' best portfolio submissions enabled NAEP to 
address questions such as: (1) Were there any differences between male 
and female students' best portfolio writing? (2) Were there any differences 
among the best portfolio writing of students from different racial/ethnic 
backgrounds? (3) What aspects of process writing were associated with 
students' best pieces? (4) What classroom experiences were associated with 
their best pieces? and (5) How did students' best portfolio writing compare 
with their best performance on the NAEP writing assessment? 

The table below presents the total number of best narrative and 
informative papers for grades 4 and 8. The analyses conducted in Part II 
were based upon information gathered about these best pieces — such as 
their evaluative score, length, process strategies used to produce them, and 
the classroom experiences of these students. 



Number of Best Narrative and Informative 
Portfolio Papers, Grades 4 and 8* 

NUMBER OF PAPERS 
Narrative informative 

Grade A 1192 1324 

Grade 8 1830 1875 



• 792 fourth graders and 3*2 eight graders submitted both narrative 
and informative pieces in their portfolios 

SOURCE- National Assessment of Educational Progress (NAEP). 
1992 Writing Assessment 

Chapter Three of this section presents information about the level of 
best portfolio writing for male, female, White, Black, and Hispanic fourth 
and eighth graders. In Chapter Four, the association between aspects of 
process writing and the level of students' best portfolio writing is examined 
and Chapter Five discusses students' general classroom experiences as they 
related to the level of their best portfolio writing. The last chapter, Chapter 
Six, examines the connection between the level of students' portfolio writing 
and their performance on the NAEP writing assessment. 
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3 

Profiles of Students' Best Portfolio Writing 
by Race/Ethnicity and Gender 



Introduction 

In this chapter, a profile of students' performance is presented for fourth 
and eighth graders by race /ethnicity and gender, using students' best 
portfolio scores for their narrative and informative writing. Thus, 
comparisons can be made between the levels of best portfolio writing of 
males and females, and among the performance levels of White, Black, 
and Hispanic students. To further facilitate these comparisons, students' 
performance was grouped into low (scores of 1 or 2), medium (scores of 3 
or 4), and high (scores of 5 or 6) levels. The persuasive papers were not 
analyzed further because very few persuasive papers were submitted 
(see Chapter One). Also, the small number of Asian/Pacific Islander 
and American Indian students precluded reliable estimates for these 
subpopulations, although these students are included in the national 
estimates (see Appendix C). 
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Fourth Grade 



lable 3. i presents adults for the best narrative and informative writing at 
ftuuiv 4 fur the nation, as well as by race/ethnicity and gender. 21 

A comparison of the performance of the best narrative portfolio writing 
among White, Black, and Hispanic fourth graders reveals that Black and 
I lispanic students had similar levels of performance. Compared to their 
White counterparts, a higher percentage of Black and Hispanic fourth 
graders' narrative portfolio papers received low ratings and a lower 
percentage received medium ratings. 22 

For informative writing, there are no significant differences between 
the performance of White and Black fourth graders or between Blac k and 
Hispanic fourth graders. However, a lower percentage of the White fourth 
graders' best informative papers were rated as low as compared with their 
Hispanic counterparts. 

A comparison of the best narrative writing of male and female 
performance reveals that a higher percentage of males' narrative papers 
received lower ratings (49 versus 40 percent). The difference in performance 
between male and female fourth graders' informative writing was not 
statistically significant. 



:I For all of the tables in Part II, the first column of numbers presents the overall percentages of 
students for each of the row categories. For example, column one of table 3.1 shows that 74 percent 
of the students participating in this study who submitted narrative papers identified themselves as 
White; 13 percent as Hlack; and 9 percent as Hispanic. Forty-seven percent of these students were 
male and 53 percent female. The columns labeled Low, Medium, and High present the percentages 
of students across each row category. For example, the second row in Table 3.1 shows that, out of 
the participating fourth graders who identified themselves as White, 40 percent submitted narrative 
papers that were rated as low; 58 percent submitted narrative papers rated as medium; and 3 percent 
as high. 

22 For this comparison as well as all others in the remainder of the report, differences in performance 
are discussed only if they were found to be statistically significant as determined by an application of 
the Bonferonni procedure 
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Table 3.1 

Best Portfolio Scores for the Nation 

and by Race/Ethnicity and Gender, Grade 4* 

BEST PORTFOLIO SCORES**" 
Overall Low Medium High 
Percentage 1,2 3,4 5,6 



Narrative 



Nation 


100(0.0) 


45(1.7) 


53(1.8) 


2 (0.5) 


Race/Ethnicity 










White 


74(1.4) 


40 (2.1) 


58 (2.2) 


3 (0.6) 


Black 


13(1.2) 


66 (4.2) 


33 (4.1) 


1 (0.9) 


Hispanic 


9 (0.8) 


54 (4.0) 


45 (3.9) 


0 (0.2) 


Gender 










Male 


47(2.1) 


49(1.8) 


50(1.8) 


1 (0.3) 


Female 


53 (2.1) 


40 (2.1) 


56 (2.4) 


3(1.0) 


iformative 










Nation 


100 (0.0) 


61 (2.0) 


37 (2.0) 


1 (0.4) 


Race/Ethnicity 










White 


71 (1.1) 


59 (2.4) 


39 (2.4) 


1 (0.5) 


Black 


15(0.9) 


68 (3.0) 


32 (3.0) 


0 (0.0) 


Hispanic 


9(0.7) 


71 (4.4) 


29 (4.2) 


0 (0.2) 


Gender 










Male 


48(1.8) 


65 (2.7) 


35 (2.8) 


1 (0.4) 


Female 


52(1.8) 


59 (2.3) 


40 (2.3) 


1 (0.7) 



The standard errors of the estimated percentages appear in 
parentheses. It can be said with 95 percent confidence for each 
population of interest that the value tor the whole population is 
within plus or minus two standard errors of the estimate for the 
sample. In comparing two estimates, one must use the standard error 
of the difference (see Procedural Appendix for details). Percentages 
may not total 100 percent due to rounding error, 

* Approximately 4 percent of the fourth graders in this study 
identified themselves as belonging to Asian/Pacific Islander or 
American Indian race/ethnicity groups, 

**Low narrative papers were rated as Event Descriptions or 
Undeveloped Stories; Medium narrative papers were rated as 
Basic Stories or Extended Stories; and High narrative papers were 
rated as Developed Stories or Elaborated Stories. Low informative 
papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or 
Discussions; and High informative papers were rated as Developed 
Discussions or Elaborated Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP), 
1992 Writing Assessment 
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Eighth Grade 



Table 3.2 presents the best narrative and informative writing of male and 
female eighth graders, as well as White, Black, and Hispanic eighth graders. 

A comparison of eighth graders' best narrative writing by race/ 
ethnicity reveals a somewhat different pattern from that of fourth graders. 
While a lower percentage of White eighth graders' narrative papers received 
low ratings and a higher percentage received high ratings compared to the 
narrative writing of Black students, the differences in performance between 
White and Hispanic eighth graders were not statistically significant. 

For informative writing, more White eighth graders' best informative 
pieces received high ratings compared to Hispanic eighth graders. No other 
significant differences among the three groups were found 

A comparison of the best narrative writing of male and female eighth 
graders revealed a pattern similar to that of fourth graders: a higher 
percentage of males' papers received low ratings. For informative writing, 
a higher percentage of males' papers also received low ratings, compared to 
the percentage of females' papers that were rated as low. 
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Table 3.2 



Best Portfolio Scores for the Nation 

and by Race/Ethnicity and Gender, Grade 8* 



BEST PORTFOLIO SCORES** 





Overall 


Low 


Medium 


High 








0,4 


0,0 


Narrative 










Nation 


100(0.0) 


21 (1 8) 


64 (1.8) 


14 (1 1) 


Race/Ethnicitv 










White 


76 (1 .3) 


18 (2.0) 


66 (2.0) 


16 M 2) 


Black 


12(0.9) 


36 (5.6) 


57 (5.0) 


7 (3 4) 


Hispanic 


8 (0.9) 


29 (4.3) 


62 (4.4) 


9(2.9) 


Gender 










Male 


50 (2.0) 


26 (2.3) 


62 (3.0) 


12(1.7) 


Female 


50 (2.0) 


17(2.4) 


67 (2.2) 


16(1.7) 


Informative 










Nation 


100(0.0) 


31 (1.6) 


62(1.4) 


7(0.8) 


Race/Ethnicity 










White 


72 (1.3) 


30(1.9) 


62 (1.8) 


8(1.0) 


Black 


1.5 (1.1) 


35 (4.4) 


62 (4.1) 


4(1.7) 


Hispanic 


9(0.8) 


32 (5.2) 


65 (5.0) 


3(13) 


Gender 










Male 


52 (1.6) 


35 (2.1) 


60 (1.8) 


6 (0.8) 


Female 


48 (1.6) 


26 (2.2) 


65 (2.1) 


9(1.4) 



The standard errors of the estimated percentages appear in 
parentheses. It can be said with 95 percent confidence for each 
population of interest that the value for the whole population is 
within plus or minus two standard errors of the estimate for the 
sample. In comparing two estimates, one must use the standard error 
of the difference (see Procedural Appendix for details). Percentages 
may not total KM) percent due to rounding error. 

* Approximately 4 percent of the fourth graders in this study 
identified themselves as belonging to Asian/Pacific Islander or 
American Indian race /ethnicity groups. 

••Low narrative papers were rated as Event Descriptions or 
Undeveloped Stories; Medium narrative papers were rated as 
Basic Stories or Extended Stories; and High narrative papers were 
rated as Developed Stories or Elaborated Stories. Low informative 
papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or 
Discussions; and High informative papers were rated as Developed 
Discussions or Elaborated Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP), 
1VW2 Writing Assessment 
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Summary 



The analysis of students' best narrative portfolio writing reveals that 
females outperformed males, with fewer females' writing submissions 
receiving low ratings compared to that of males for both fourth and eighth 
grades. At grade 4, more White students' narrative submissions received 
high ratings compared to the work submitted by their Black and Hispanic 
counterparts. At grade 8, White students performed better than Black 
students on narrative writing. 

The analysis of students' informative portfolio entries shows little 
difference at fourth grade between male and female students' performance, 
while at the eighth grade more male students' informative writing received 
low ratings. White fourth graders outperformed their Hispanic counterparts 
and, at grade 8, more White than Hispanic students' best informative papers 
received high ratings. 
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4 

Process Writing and Students 7 
Best Portfolio Writing 



Introduction 

In this chapter various features of students' best portfolio writing, identified 
during the descriptive analysis (see Chapter One), are related to the level of 
students' performance. In this way, questions such as the following can be 
addressed: what types of process strategies did students use to produce 
their best pieces; what other aspects of proo s approaches to writing 
instruction did they use; and what key features of writing are associated 
with students' best portfolio writing. 
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What Types of Process Strategies 

Did Students Use to Produce Their Best Portfolio Pieces? 



As discussed in Chapter One, based on evidence from the teacher 
questionnaire, students' writing, and students' letters, students' portfolio 
entries were analyzed based on whether there was evidence of the use of 
process strategies, and if so, what kinds. The types of process strategies 
considered were: pre-writing, peer-conferencing, teacher conferencing, use 
of resources, revising, peer editing, teacher editing, and publication/sharing 
of a final product. Writing educators maintain that, while any of these 
strategies may be useful in producing effective writing, the use of several 
process strategies seems to be most conducive to the generation of high 
quality writing. 23 

Thus, the next step in the analysis was to examine the association 
between the level of students' best portfolio writing and the number of 
process strategies they used to produce these pieces. Tables 4.1 through 4.4 
present information about this association for the fourth and eighth graders. 

Fourth Graders. As presented in Tables 4.1 and 4.2, 34 percent of 
the fourth graders' best narrative writing and 33 percent of their best 
informative writing showed no evidence of the use of process strategies. 
Twenty-seven percent of their best narrative and 23 percent of their best 
informative writing appeared to have been written using one type of 
process strategy, while 39 percent of their best narrative and 43 percent 
of their best informative writing involved the use of two or more 
process strategies. 



J1 Moffet, J. and W^ncr, li.J Student Centered I tin^uu^e Att\ k-12, fourth edition (Portsmouth, N|: 
Bovnton/Conk Publishers, PW2). 
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Table 4.1 

Use of Process Strategies and 

Students' Best Narrative Portfolio Writing, Grade 4 






BEST NARRATIVE 
PORTFOLIO SCORES* 


Use of Process 
Strategies 


Overall 
Percentage 


Low Medium High 
1,2 3,4 5,6 


No Evidence 
One Strategy 
Two or More Strategies 


34 (1.8) 
27(1.4) 
39 (2.1) 


58 (2.7) 41 (2.6) 1 (0.5) 
44(3.1) 55(3.0) 1 (0 6) 
33(2.9) 63(3.0) 4(1 3) 



The standard errors of the estimated percentages appear in parentheses. It cm ho 
said with 95 percent confidence for each population of interest that the value fov 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. Percentages may not total 100 percent due to rounding error. 

* Low narrative papers were rated as Event Descri?" ions or Undeveloped Stories; 
Medium narrative papers were rated as Basic Stoiies or Extended Stories; and 
High narrative papers were rated as Developed Stories or Elaborated Stories. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 



An examination of fourth graders' best narrative writing revealed 
an association between their use of process strategies and their level of 
writing. A significantly higher percentage of the papers written without 
the use of process strategies received low ratings compared to those 
written with the use of one, or with the use of two or more process 
strategies. Also, a significantly higher percentage of papers written using 
one strategy received low ratings compared to those written using two or 
more strategies. A significantly higher percentage of the papers written 
using one strategy or using two or more strategies received medium ratings 
compared to the papers written without the use of process strategies. 

An association also existed between the use of process strategies and 
the level of fourth graders' informative writing (Table 4.2). A significantly 
higher percentage of the papers written without the use of process strategies 
received low ratings compared to those written with the use of one, or 
with the use of two or more process strategies. Also, a significantly higher 
percentage of the papers written using one strategy or using two or more 
strategies received medium ratings compared to those written without the 
use of process strategies. 
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Table 4.2 

Use of Process Strategies and 

Students' Best Informative Portfolio Writing, Grade 4 







BEST INFORMATIVE 






PORTFOLIO SCORES* 


Use of Process 


Overall 


Low 


Medium High 


Strategies 


Percentage 


1,2 


3,4 5,6 


No Evidence 


33 (1.6) 


72 (2.7) 


27 (2.5) 0 (0.5) 


One Strategy 


23 (1.5) 


58 (3.9) 


41 (3.9) 0(0.1) 


Two or More Strategies 


43 (1.9) 


55 (2.8) 


43 (2.8) 2 (0 8) 



The standard errors of the estimated percentages appear in parentheses. It can be 
said with 95 percent confidence for each population of inter' st that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. Percentages may not total 100 percent due to rounding error. 

* Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; and 
High informative papers were rated as Developed Discussions or Elaborated 
Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 

Eighth Graders. As presented in Tables 4.3 and 4.4, 27 percent of 
the eighth graders' best narrative writing and 29 percent of their best 
informative writing showed no evidence of the use of process strategies. 
Twenty-five percent of their best narrative and 24 percent of their best 
informative writing appeared to have been written using one type of 
process strategy, while 48 percent of their narrative and 47 percent of their 
best informative writing involved the use of two or more process strategies. 
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Table 4.3 



Use of Process Strategies and 

Students' Best Narrative Portfolio Writing, Grade 8 



BEST NARRATIVE 
PORTFOLIO SCORES' 

Use of Process Overall Low Medium High 

Strategies Percentage 1 ,2 3,4 5,6 



No Evidence 
One Strategy 
Two or More Strategies 



27 (2.0) 
25(1.9) 
48 (2.4) 



28 (2.6) 
24 (3.7) 
16(2.4) 



61 (2.8) 

65 (3.4) 

66 (2.5) 



11 (1.9) 
11 (2.0) 
18(1.5) 



The standard errors ot the estimated percentages appear in parentheses. It can he 
said with ^5 percent conhdctue lor each population ot interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample Percentages ma\ not total 100 percent due to rounding error. 

* Low narrative papers v\cro rated as l : \ent Descriptions or Undeveloped Stories; 
Medium narrative papers were rated as Basic stories or Fx tended Stories; and 
High narrative papers were rated as Developed Stones or Hlahorated Stories. 

SOL'RCK: National Assessment of t ducational Progress (NAHP), 1*W2 
Writing Assessment 

Thus, an association existed between the number of process strategies 



used by eighth graders to produce their best narrative writing and their 
levels of performance- A significantly higher percentage of the papers 
written without the use of process strategies received low ratings than 
did those written with the use of two or more process strategies. Also, a 
significantly higher percentage of the papers written using two or more 
strategies received high ratings than did those written without the use of 
process strategies or with the use of one strategy. 




Table 4.4 



Use of Process Strategies and 

Students' Best Informative Portfolio Writing, Grade 8 







BEST INFORMATIVE 






PORTFOLIO SCORES* 


Use of Process 


Overall 


Low 


Medium High 


Strategies 


Percentage 


1,2 


3.4 5,6 


No Evidence 


29 (1.9) 


37 (2.9) 


56(2.8) 7(1.5) 


One Strategy 


24(1.4) 


32(3.0) 


62(2.7) 7(1.3) 


Two or More Strategies 


47(2.1) 


26 (2.1) 


66(2.0) 8(1.1) 



The standard errors of the estimated percentages appear in parentheses. It can be 
said with 95 percent confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. Percentages may not total 100 percent due to rounding error. 

* Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; and 
High informative papers were rated as Developed Discussions or Elaborated 
Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP). 1992 
Writing Assessment 

An association also existed between the number of process strategies 
used by eighth graders to produce their best informative writing and their 
levels of performance (Table 4.4). A significantly higher percentage of the 
papers written without the use of process strategies received low ratings 
than did papers written with the use of two or more process strategies. Also, 
a significantly higher percentage of the papers written using two or more 
strategies received medium ratings than did those written without the use 
of process strategies. 

Thus, fourth graders who used at least one process strategy to produce 
their best narrative or informative piece outperformed those who had not 
used process strategies. By the eighth grade, the difference in performance 
levels was between those who had not used process strategies and those 
who had used at least two of these strategies. 
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What Other Aspects of Process Approaches to Writing 
Instruction Were Used for Students' Best Portfolio Pieces? 

Two aspects of process approaches to writing instruction that may have 
been involved in the production of students' best portfolio pieces were 
examined. These included choice of topic and type of audience. 

Choice of Topic. Tables 4.5 and 4.6 present information about whether 
students' choice of topic was associated with the ratings their best pieces 
received. Only 11 percent of the fourth graders' best narrative pieces and 
6 percent of their best informative pieces were composed on a topic of their 
own choosing. 



Table 4.5 

Choice of Topic for 

Students' Best Portfolio Writing, Grade 4 



BEST PORTFOLIO SCORES* 





Overall 


Low 


Medium 


High 


Choice of Topic 


Percentages 


1,2 


3,4 


5,6 


Narrative 










Yes 


11(0.9) 


37 (4.5) 


61 (4.3) 


2(1.4) 


No 


89(0.9) 


46(1.8) 


52 (1.9) 


2 (0.6) 


Informative 










Yes 


6 (0.9) 


67 (7.2) 


31 (6.8) 


3 (2.8) 


No 


94 (0.9) 


61 (2.1) 


38 (2.1) 


1 (0.4) 



The standard errors of the estimated percentages appear in parentheses. It can be 
said with 95 percent confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. In comparing two estimates, one mu:;» use the standard error of 
the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 

' Low narrative papers were rated as Hvent Descriptions or Undeveloped 
Stories; Medium narrative papers were rated as Basic Stories or Extended Stories; 
and 1 ligh narrative papers were rated as Developed Stories or Elaborated Stories. 
Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; 
and I Ugh informative papers were rated as Developed Discussions or 
Elaborated Discussions. 

SOPKlT National Assessment of Lduoitiun.il Progress (N A EI'), 1992 
Writing Assessment 
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Table 4.6 presents information about eighth graders' choice of topic 
and their level of best portfolio writing. Only 15 percent of the eighth 
graders' best narrative pieces and 6 percent of their best informative pieces 
were composed on a topic of their choosing. 

Among the students whose best narrative piece was written to a 
topic that they had chosen, 12 percent received low ratings, 56 percent 
received medium ratings, and 32 percent received high ratings. The 
performance of those students who did not choose their own narrative 
topics was different — 23 percent received low ratings, 66 percent received 
medium ratings, and 11 percent received high ratings. A significantly 
higher percentage of students who had not chosen their own topic received 
low ratings compared with those who had chosen their topic. Likewise, 
a significantly higher percentage of students who had chosen their topic 
received high ratings compared with those who had not chosen their topic. 



Table 4.6 

Choice of Topic for 

Students' Best Portfolio Writing, Grade 8 



BEST PORTFOLIO SCORES* 





Overall 


Low 


Medium 


High 


Choice of Topic 


Percentages 


1,2 


3,4 


5,6 


Narrative 










Yes 


15(1.6) 


12(2.8) 


56 (5.3) 


32 (5.4) 


No 


85 (1.6) 


23 (2.1) 


66(1.9) 


11(1.2) 


Informative 










Yes 


6(0.9) 


33 (5.5) 


53 (6.1 ) 


14(4.1) 


No 


94 (0.9) 


31 (1.6) 


63(1.4) 


7(0.9) 



The standard errors of the estimated percentages appear in parentheses. It can bo 
said with 95 percent confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of 
the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 

• Low narrative papers were rated as Event Descriptions or Undeveloped 
Stories; Medium narrative papers were rated as Basic Stories or Extended Stones, 
and High narrative papers were rated as Developed Stories or Elaborated Stories. 
Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; 
and High informative papers were rated as Developed Discussions or 
Elaborated Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP), IW2 
Writing Assessment 
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For the eighth graders' best informative pieces, among the 6 percent 
who wrote to a topic of their own choosing, 33 percent received low ratings, 
53 percent received medium ratings, and 14 percent received high ratings. 
This level of performance is similar to those who did not choose their own 
informative topic — 31 percent received low ratings, 63 percent received 
medium ratings, and 7 percent received high ratings. 

Thus, for fourth graders, having chosen one's own topic was not 
associated with higher levels of narrative or informative portfolio writing. 
However, at grade 8, students who had chosen the topic of their narrative 
pieces outperformed those who wrote to assigned topics. This association 
was not found for eighth-grade informative writing, where the levels of 
performance were similar for students who had and had not chosen their 
own topic. 



What Other Features of Students' Writing 
Were Associated with Best Performance? 

Two other features of students' writing were associated with the 
performance level of their best writing: the length of time that they spent 
producing their best pieces and the approximate length of these pieces. 

Time Engaged in Writing Activity. In Tables 4.7 and 4.8, the levels of 
students' best portfolio writing at grades 4 and 8 are compared with the 
amounts of time their teachers reported that students had engaged in the 
writing activities which generated their work. Sometimes the teacher did 
not include information about how long the student had engaged in the 
writing activity (10 to 12 percent of the time). The performance of these 
students is reported in the row titled "Omitted''. 
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Table 4.7 

Time Engaged in Writing Activity 

for Students' Best Portfolio Writing, Grade 4 







BEST PORTFOLIO SCORES* 


Time Reported 


Overall 


Low 


Medium 


High 


by Teacher 


Percentage 


1,2 


3,4 


5,6 


Narrative 










Omitted 


10 (0.9) 


57 (3 0) 


43(3.0) 


0(0.0) 


0-25 Minutes 


11(1.0) 


72 (3 8) 


28(3.8) 


0(0 0) 


26-50 Minutes 


23(2.1) 


53(3 4) 


46(3 6) 


1 (0 8) 


More Than 50 Minuter 


56 (2.4) 


34(2 3) 


63(2 4) 


3(0 9) 


Inloi niative 










Omitted 


13(1.6) 


(3 9) 


31 (3 9) 


0(0 0) 


0-25 Minutes 


14(1.1) 


80(3 3) 


20(3 2) 


1(10) 


26-50 Minutes 


21 (1.5) 


7i) (3 2) 


29 (3 2) 


0(0 1) 


More Than 50 Minutes 


52(1.9) 


52(2(3) 


46(2 /) 


2(0 6) 


Tin* standard errors nt llu» 


estimated |M'U t 


nta>;es appi 


,n in pa i en theses 


ll i an he 



said with 95 percent confidcine toi e,u h population ol interest that the \ a!ue tor 
the whole population is within plus ot minus two standatd eriors ol the estimate 
for the sample. In comparing two estimates one nuisi use the standard error ol 
the difference (see Procedural Appendix lot details) Pcuenlages inav not total 
UK) percent due to rounding erroi 

* Low narrative papers were rated as I \enl I )esiMplmnsur Undeveloped 
Stories; Medium narrative papers wue ta led .is Has u SI ones or Extended Stones; 
and High narrative papers wore rated *»s I )e\ eloped Stories or Elaborated Stories. 
Low informative papers were rated as I istmgsor Attempted Discussions; Medium 
informative papers were rated .is I ndes eloped I )is< ussmns or Discussions; 
and High informative papers weie nited .is I )e\ eloped Discussions or 
Elaborated Discussions. 

SOURCE: National Assessment ot I ,lu, alional Ptogiess iNAEP). 1<W2 
Writing Assessment 

Eleven percent of the iourth graders' best narrative writing was 
produced in 25 minutes or less; 2,1 percent in 2h-5|) minutes; and 56 percent 
in more than 50 minutes. 

At grade 4, an association existed between the amount of time spent on 
the best pieces and the ratings these pieces received, hirst, lor both types of 
writing, a significantly higher percentage ol papers written in 25 minutes 
or less received low ratings compared with those written In 2h-5() minutes 
and those written in more than 50 minutes. Also, a siguilU antlv higher 
percentage of narrative papers written in 2o-M) minutes retelved low 
ratings compared with those written in more than 50 minutes. Second, a 
significantly higher percentage ol papers written in more than 50 minutes 
received medium ratings compared with those written In > (\ Ml minutes 
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and those written in 25 minutes or less. Also, for narrative writing, a 
significantly higher percentage of papers written in 26-50 minutes received 
medium ratings compared with papers written in 25 minutes or less. 

Table 4.8 presents the level of eighth graders' best portfolio writing 
compared with the time their teachers reported that they engaged in the 
writing activities which had generated their work. 



Table 4.8 

Time Engaged in Writing Activity 

for Students' Best Portfolio Writing, Grade 8 



BEST PORTFOLIO SCORES* 



Time Reported 


Overall 


Low 


Medium 


High 


by Teacher 


Percentage 


1,2 


3,4 


5,6 


Narrative 










Omitted 


12(1.6) 


20 (3.9) 


66 (4.2) 


14 (3.0) 


0-25 Minutes 


7(1.1) 


46 (9.6) 


50 (9.8) 


5 (4.8) 


26-50 Minutes 


16(1.9) 


33 (4.6) 


62 (4.8) 


5(1.9) 


More Than 50 Minutes 


66(2.8) 


16(1.8) 


66 (2.1) 


18(1.5) 


Informative 










Omitted 


12(1.4) 


32 (3.5) 


64 (3.8) 


4(1.1) 


0-25 Minutes 


9(1.1) 


58 (5.4) 


42 (5.4) 


0 (0.0) 


26-50 Minutes 


17(1.7) 


43 (4.0) 


55 (3.9) 


2 (0.8) 


More Than 50 Minutes 


63 (2.5) 


23 (1.9) 


67(1.7) 


10(1.2) 



The standard errors of the estimated percentages appear in parentheses. It can be 
said with 95 percent confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of 
the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 

* Low narrative papers were rated as Event Descriptions or Undeveloped 
Stories; Medium narrative papers were rated as Basic Stories or Extended Stories; 
and High narrative papers were rated as Developed Stories or Elaborated Stories. 
Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; 
and High informative papers were rated as Developed Discussions or 
Elaborated Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 

At grade 8, only 7 percent of the students' best narrative writing was 
produced in 25 minutes or less; 16 percent in 26-50 minutes; and 66 percent 
in more than 50 minutes. Among the small percentage of papers written in 
25 minutes or less, 46 percent received low ratings, 50 percent medium 
ratings, and 5 percent high ratings. Of the papers written in 26-50 minutes, 
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33 percent received low ratings, 62 percent medium ratings, and 5 percent 
high ratings. And lastly, among the papers written in more than 50 minutes, 
only 16 percent received low ratings, while 66 percent received medium 
ratings and 18 percent high ratings. 

As with the fourth grade, a relationship existed between the amount 
of time spent on the best pieces and the ratings these pieces received for 
the eighth grade. First, for both types of writing, a significantly higher 
percentage of papers written in 25 minutes or less received low ratings 
compared with those written in more than 50 minutes. Also, a significantly 
higher percentage of papers written in 26-50 minutes received low ratings 
compared with those written in more than 50 minutes. Second, for 
informative writing a significantly higher percentage of papers written 
in more than 50 minutes received medium ratings compared with those 
written in 26-50 minutes and those written in 25 minutes or less. Lastly, 
a significantly higher percentage of narrative papers written in more than 
50 minutes received high ratings compared with those written in 26-50 
minutes; and a significantly higher percentage of informative papers 
written in more than 50 minutes received high ratings Cv/inpared with both 
smaller time intervals. 

The results presented above indicate a definite relationship between 
evaluative ratings of students' portfolio writing and the length of time 
students spent generating the piece of writing. The main reason teachers 
were asked about the length of the classroom writing activities was to obtain 
confirmation that students were engaging in more complex writing process 
activities. Following a writing process curriculum requires that activities be 
designed that extend over several days and involve a wide variety of 
reading, writing, listening, and speaking events. 

While a writing activity that takes place over several class periods 
may not necessarily be a process-type activity, it would be difficult to 
develop an activity that involved drafting, peer conferencing, and revision 
in one class period. Thus, time is a necessary element of process writing 
curricula, but it is not sufficient to guarantee high-level writing — some of 
the portfolio entries that were the result of classroom activities extending 
over 50 minutes in length still received lower ratings. However, very few of 
the papers written in 25 minutes or less received the highest ratings. 

Approximate Length of Best Portfolio Pieces. Tabids 4.9 and 4.10 present 
information about the approximate length of students' best portfolio pieces 
and the level of their best pieces for grades 4 and 8. 



98 

106 



Table 4.9 

Approximate Length of Papers for 
Students' Best Portfolio Writing, Grade 4 



BEST PORTFOLIO SCORES* 



Approximate Length 


Overall 


Low 


Medium 


nign 


of Papers 


Percentages 


1,2 


3,4 


5,0 


Narrative 










1-50 Words 


8 (0,8) 


96 (2.6) 


4 (2.6) 


0 (0.0) 


51-100 Words 


24(1.3) 


80 (2.5) 


20 (2.5) 


0 (0.0) 


101-200 Words 


41 (2.0) 


37 (2.8) 


62 (2.8) 


1 (0.5) 


201-400 Words 


20(1.1) 


15(3.3) 


82 (3.5) 


3(1.4) 


More Than 400 Words 


8(1.3) 


4(1.9) 


80 (4.7) 


17 (4.6) 


Informative 










1-50 Words 


21 (1.8) 


97(1 4) 


3(1 4) 


0 (0.0) 


51-100 Words 


35 (1.2) 


76 (2.5) 


24 (2.5) 


0(0.0) 


101-200 Words 


29(1.4) 


43 (3.7) 


57 (3.7) 


0(0.1) 


201 -400 Words 


12(1.1) 


20 (3.5) 


75 (4.1) 


5 (2.4) 


More Than 400 Words 


4(0.7) 


3(2.3) 


83 (7.5) 


15(7.2) 



I ho sJ.tnil.itii enois of the estimated percentages appear in parentheses. It can be 
said with ^ petient i onfidciu e tor each population of interest that the value for 
the wholi' population is wiOun plus or minus two standard errors of the estimate 
for the sample In loinpanng two estimates, one must use the standard error of 
the difference (see Puncdutal Appendix for details) Percentages may not total 
100 percent due to rounding error. 

• Low narrative papers were rated as I vent Descriptions or Undeveloped 
Stories; Medium narratise papers were rated as Basic Stories or Extended Stories: 
and High narrative papers were rated as Developed Stories or Elaborated Stories. 
Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; 
and High informative papers were rated as Developed Discussions or 
Hlaborated 1 )isi ussions 

SOL'Rt I- National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 

In considering fourth graders' best narrative portfolio writing, 
8 percent were 50 words or less; 24 percent were 51-100 words long; 
41 percent were 101-200 words long; 20 percent were 201-400 words long; 
and 8 percent were more than 400 words. In general, a higher percentage 
of papers that were shorter in length (100 words or less) received low 
ratings; and a higher percentage of longer papers (over 200 words) 
received medium ratings. 

A similar pattern is found in fourth graders' best informative portfolio 
writing. Twenty-one percent of this writing was 50 words or less in length; 
35 percent 51-100 words long; 29 percent 101-200 words long; 12 percent 
201-400 words long; and only 4 percent was more than 400 words in length. 
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A higher percentage of papers of 100 words or less received low ratings, 
while a higher percentage of papers over 100 words received 
medium ratings. 

Table 4.10 presents information about eighth graders' best portfolio 
writing and the approximate length of these papers. As shown in the first 
column, only 1 percent of the narrative papers were 50 words or less; 
11 percent were 51-100 words long; 29 percent were 101-200 words long; 
35 percent were 201-400 words long; and 25 percent were more than 
400 words. In general, a higher percentage of papers that were shorter in 
length (200 words or less) received low ratings; a higher percentage of 
longer papers (over 100 words) received medium ratings; and a higher 
percentage of papers of more than 400 words received high ratings. 
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Table 4.10 

Approximate Length of Papers for 
Students' Best Portfolio Writing, Grade 8 



BEST PORTFOLIO SCORES* 



Approximate Length 


Overall 


Low 


Medium 


High 


of Papers 


Percentages 


1,2 


3,4 


5,6 


Narrative 










1-50 Words 


1 (0.4) 


92(11.3) 


8(11.3) 


0 (0.0) 


51-100 Words 


11(1.2) 


74 (4.0) 


26 (4 0) 


0 (0.0) 


101-200 Words 


29 (2.0) 


33 (3.0) 


66 (2.9) 


2(1.2) 


201 -400 Words 


35 (1.8) 


7(1.6) 


87(1.7) 


6(1-2) 


More Than 400 Words 


25 (1.9) 


2(1.0) 


51 (3.2) 


47 (3.4) 


Informative 










1-50 Words 


4(0.7) 


90 (5.0) 


7 (3.8) 


3 (2.9) 


51-100 Words 


21 (1.3) 


66 (2.8) 


34 (2.8) 


0 (0.0) 


101 -200 Words 


36 (1.8) 


29 (2.1) 


71 (2.1) 


0 (0.0) 


201-400 Words 


26 (1.7) 


7(1.5) 


85(1.9) 


7(1.7) 


More Than 400 Words 


12(1.4) 


3(1.4) 


55 (3.9) 


42 (4.0) 



The standard errors of the estimated percentages appear in parentheses. It can be 
said with 95 percent confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of 
the difference (see Procedural Appendix tor details). Percentages may not total 
100 percent due to rounding error. 

* Low narrative papers were rated as Event I )ex riptions or Undeveloped 
Stories; Medium narrative papers were rated as Hash" Stories or Extended Stones; 
and High narrative papers were rated as Developed Stories or Elaborated Stories. 
Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers* were rated as Undeveloped Discussions or Discussions; 
and High informative papers were rated as Developed Discussions or 
Elaborated Discussions. 

SOURCE: National Assessment of Ediuahonal Progress (NAEP), W2 
Writing Assessment 



A similar pattern was found in eighth graders' best informative 
portfolio writing. Only 4 percent of this writing was 50 words or less in 
length; 21 percent 51-100 words long; 36 percent 101-200 words long; 
26 percent 201-400 words long; and 12 percent more than 400 words in 
length. A higher percentage of papers of 200 words or less received low 
ratings, while a higher percentage of papers over 200 words received 
medium ratings. Also, a higher percentage of papers over 400 words 
received high ratings compared with papers of shorter lengths. 
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Use of Computers. Few students at the fourth or eighth grade submitted 
portfolio pieces that were typed or printed using a computer — less than 
10 percent at grade 4 and only 15 percent at grade 8. Table 4.11 presents 
information about students' computer use and the level of their best 
portfolio writing. 

For both narrative and informative fourth-grade papers, a significantly 
lower percentage of typed papers received low scores and a higher 
percentage received medium scores compared with the percentage of 
handwritten papers. Similarly, at grade 8, for both types of writing, a 
significantly lower percentage of typed papers received low scores and a 
higher percentage received high scores compared with handwritten papers. 
Thus, for both grade levels and both types of papers, computer use was 
associated with higher portfolio performance. 

This association raises a question about whether the readers who 
evaluated students' portfolio writing rated typed papers higher than 
handwritten because they appeared to be more sophisticated, compared to 
the handwritten papers. So few papers submitted in portfolio folders were 
typed that we did not design a study specifically to address this question. 
However, recent research in this area reports that readers are not unduly 
influenced by typed papers and often they seem to expect more from typed 
papers and, thus, apply evaluation criteria more rigorously to typed than to 
handwritten papers. 24 



24 Powers, DM, Fowles, Mi:., Farnum, M., ,ind Ramsey, l\ Will They Think Less of My Handwritten Essay 
if Others Word Process Theirs? (Princeton, NJ: l-diicntion.il Testing Service, 1992). 



Table 4.11 

Use of Computer for 

Students' Best Portfolio Writing, Grades 4 and 8 



BEST PORTFOLIO SCORES* 





Overall 


Low 


Medium 


High 


Choice of Topic 


Percentages 


1,2 


3,4 


5,6 


Grade 4 










Narrative 










Yes 


7(1.1) 


19(4.3) 


71 (4.3) 


10(3.6) 


No 


93(1.1) 


47(1.7) 


52 (1.8) 


«*» /A A \ 

2 (0.4) 


Informative 










Yes 


6(1.0) 


39 (6.5) 


57 (8.1) 


3 (2.8) 


No 


94 (1.0) 


63(1.9) 


36(1.9) 


1 (0.4) 


Grade 8 










Narrative 










Yes 


15(1.3) 


11 (2.6) 


57 (3.6) 


32 (4.1) 


No 


85(1.3) 


23(1.9) 


66 (2.0) 


11(1.2) 


Informative 










Yes 


15(1.9) 


12 (2.3) 


66 (2.7) 


22 (3.2) 


No 


85(1.9) 


34(1.8) 


62(1.6) 


5 (0.6) 



The standard errors of the estimated percentages appear in parentheses. It can be 
said with 95 percent confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error o» 
the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 

* Low narrative papers were rated as Event Descriptions or Undeveloped 
Stories; Medium narrative papers were rated as Basic Stories or Extended Stories; 
and High narrative papers were rated as Developed Stories or Elaborated Stories. 
Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; 
and High informative papers were rated as Developed Discussions or 
Elaborated Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 



Summary 

Several aspects of process approaches to writing and features of students' 
portfolio writing were associated with their best portfolio submissions: 
(1) use of process strategies; (2) choice of topic; (3) time spent writing the 
portfolio piece; (4) length of the portfolio piece; and (5) use of computers 
to produce the piece. 



in 



Students in both fourth and eighth grades who used process strategies 
when writing their best narrative and informative pieces outperformed 
those who showed no evidence of the use of process strategies. At grade 8, 
students who chose their own topic for their best narrative piece performed 
better than those who wrote to an assigned topic. 

Time spent producing portfolio pieces was associated with best 
narrative and informative portfolio writing at both grades, with students 
who spent more than 50 minutes outperforming those who spent less time. 
The length of students' portfolio submissions also was related to the level of 
their narrative and informative portfolio writing. Lastly, for both fourth and 
eighth graders, students who produced narrative or informative writing on 
computer outperformed those whose papers were handwritten. 
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5 

Classroom Contexts and Students' 
Best Portfolio Writing 



Introduction 

In considering what factors may be related to the quality of students' 
portfolio submissions, an analysis of the classroom contexts which 
generated the students' best portfolio writing was conducted. First, the 
types of classroom activities that generated students' best portfolio writing 
are presented. As was discussed in Chapter One, this information was 
obtained from the teacher questionnaires, the students' letters to NAEP, and 
any other evidence in the portfolios that may have indicated the types of 
activities in which the students had engaged. 

Next, information about various elements of instruction and students' 
classroom experiences was obtained from questionnaires given to the 
participating fourth and eighth graders and to the teachers of the eighth- 
grade students at the time of the main NAEP assessment. Unlike the other 
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features discussed, which all related specifically to students' portfolio 
submissions, these elements of writing instruction relate to students' general 
school experiences. 

This chapter first addresses the question of what types of classroom 
activities generated students' best portfolio pieces, and then it examines 
what general classroom experiences were associated with students' best 
portfolio writing. 

What Types of Classroom Activities 
Generated Students' Best Portfolio Writing? 

Table 5.1 presents the number of best papers received for each of the four 
types of classroom activities discussed in Chapter One. The proportion was 
similar to that of the entire set of portfolio papers: most students were 
engaged in integrated activities, with some responding to general prompts 
and a few responding to focused prompts or content reports. 



Table 5.1 

Number of Best Papers for 

Each Type of Activity, Grades 4 and 8 

4TH GRADE 8TH GRADE 



Narrative Informative Narrative Informative 



General Prompts 


312 


322 


163 


253 


Focused Prompts 


68 


82 


44 


98 


Content Reports 


7 


55 


8 


98 


Integrated Activities 


638 


638 


583 


745 


SOURCE N.ition.i1 Asm 


ssmrnt of I'llur, 


tion.il IVoy 


;rrv»(NAM*), \W2 
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Tables 5.2 and 5.3 examine the relationship between the level of 
students' best portfolio writing and the types of activities to which they 
were responding. At the fourth grade, over half of their narrative pieces 
(55 percent) were written as part of integrated activities; 24 percent- 
were written in response to general prompts; and only 5 percent to 
focused prompts. 
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Among the papers written to general prompts 55 percent received low 
ratings, 44 percent medium ratings, and 1 percent high ratings. Similar 
results occurred for the few papers written to focused prompts. In contrast, 
a significantly lower percentage of the papers written as part of integrated 
activities received low ratings (only 37 percent) and a significantly higher 
percentage received medium ratings (60 percent). 

A similar pattern held for fourth graders' best informative writing. 
Almost one-quarter (23 percent) of these papers were written in response to 
general prompts and almost half (49 percent) were the result of integrated 
activities, with only 6 and 5 percent written in response to focused prompts 
and content reports, respectively. 

Among the informative papers written to general prompts, 72 percent 
received low ratings, 27 percent medium ratings, and 1 percent high ratings; 
with similiar percentages for the few papers written to focused prompts. 
In contrast, a significantly lower percentage of content reports (29 percent) 
and integrated activities (57 percent) received low ratings compared with 
general prompts. Also, a significantly higher percentage of content reports 
(62 percent) and integrated activities (42 percent) received medium ratings 
compared with general prompts. 
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Table 5.2 

Types of Writing Activities and 
Students' Best Portfolio Writing, Grade 4 

BEST PORTFOLIO SCORES* 
Overall Low Medium High 
Types of Activities Percentage 1 ,2 3,4 5,6 



Narrative 
General Prompts 
Focused Prompts 
Gontent Reports 
Integrated Activities 
Unknown 

Informative 
General Prompts 
Focused Prompts 
Gontent Reports 
Integrated Activities 
Unknown 



24(1.8) 55(2.9) 

5(0.8) 60(7.0) 
0(0.2) 

55(2.0) 37 (1.9) 

14(1.1) 53(3.9) 



23(1.3) 72 (3.0) 

6(0.8) 69(7.1) 

5(0.7) 29 (6 5) 

49(1.7) 57 (2.5) 

17(1.3) 67(4.1) 



44 (2.8) 1 (0.5) 

40 (7.0) 0 (0.0) 

AAA AAA 

60(1.8) 3(0.9) 

45(4.1) 3(1.4) 



27 (2.8) 1 (0.6) 

31 (7.1) 0(0.0) 

62 (8.0) 9 (5.0) 

42 (2.5) 1 (0.6) 

33(4.1) 0(0.1) 



The standard errors of the estimated pen/entases appear in parentheses. It can be 
said with 95 percent confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of 
the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 

* Low narrative papers were rated as Event Descriptions or Undeveloped Stories; 
Medium narrative papers were rated as Basic Stories or Extended Stories; and 
High narrative papers were rated as Developed Stories or Elaborated Stories. 
Low informative papers were rated as Listings or Attempted Discussions; 
Medium informative papers were rated as Undeveloped Discussions or 
Discussions; and High informative papers were rated as Developed 
Discussions or Elaborated Discussions. 

** Sample size insufficient to permit reliable estimate. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 
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Table 5.3 presents information about eighth graders' level of 
portfolio performance and the types of activities to which they wrote. 
Sixty-two percent of the eighth-grade narrative writing was written as 
part of integrated activities; less than one-fifth (18 percent) was written in 
response to general prompts; only 5 percent to focused prompts, and just 
1 percent were content reports. Little difference in performance was found 
between papers written to these different types of activities. 

As with narrative writing, 57 percent of the eighth graders' Lvjst 
informative writing was written as part of integrated activities. Less than 
one-fifth (19 percent) was written in response to general prompts and only 
7 and 5 percent were written in response to focused prompts or content 
reports, respectively. A significantly lower percentage of content reports 
(8 percent) received low ratings compared with the other types of activities. 
Also, a significantly higher percentage of content reports (32 percent) 
received high ratings compared with the other types of activities. Yet, 
please keep in mind that only 5 percent of the eighth graders' best 
informative papers were content reports. 

Thus, at the fourth grade, higher achievement was associated with 
the use of integrated activities for both narrative and informative portfolio 
writing. At eighth grade, however, the type of activity was unrelated to the 
level of narrative writing. For eighth-grade informative writing, the small 
percentage who submitted content reports received significantly higher 
ratings than those who submitted papers written in response to other 
types of classroom activities. 
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Table 5.3 

Types of Writing Activities and 
Students' Best Portfolio Writing; Grade 8 

BEST PORT FOL IO SCOR ES* 
Overall Low Medium High 
Types of Activities Percentage 1 ,2 3,4 5,6 



Narrative 
General Prompts 
Focused Prompts 
Content Reports 
Integrated Activities 
Unknown 

Informative 
General Prompts 
Focused Prompts 
Content Reports 
Integrated Activities 
Unknown 



18(1.5) 22(3.6) 

5(1.0) 38(7.6) 
1(0.5) 

62(2.2) 19(2.0) 

13(1.5) 23(4.4) 



19(1.4) 37(2.7) 

7 (0.8) 37 (5.9) 

5(0.7) 8(2.8) 

57(2.5) 30 (2.1) 

12(1.5) 31 (4.3) 



68(3.9) 10(3.0) 

53 (9.4) 9 (5.6) 

* * * * * * 

66(2.2) 15(1.2) 

61 (4.2) 16(3.7) 



60 (2.7) 3 (0.6) 

56 (6.4) 7 (3.2) 

60 (5.3) 32 (6.2) 

64(2.0) 7(1.2) 

62(4.5) 7(1.7) 



The standard errors of the estimated percentages appear in parentheses. It can be 
said with 95 percent confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of 
the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 

* Low narrative papers were rated as Event Descriptions or Undeveloped Stories; 
Medium narrative papers were rated as Basic Stories or Extended Stories; and 
High narrative papers were rated as Developed Stories or Elaborated Stories. 
Low informative papers were rated as Listings or Attempted Discussions; 
Medium informative papers were rated as Undeveloped Discussions or 
Discussions; and High informative papers were rated as Developed Discussions 
or Elaborated Discussions. 

*** Sample size insufficient to permit reliable estimate. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 
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What General Classroom Experiences 

Were Associated with Students' Best Portfolio Writing? 



Several aspects of students' classroom writing experiences were 
associated with the level of their best portfolio writing. This section 
presents information about the time students spent in and out of school 
on writing, the length and frequency of students' writing assignments, 
the use of process approaches to writing instruction, and teachers' overall 
ratings of their students' writing abilities. This information was provided by 
the questionnaires students and eighth-grade teachers answered as part of 
the main 1992 NAEP writing assessment. 

Time Spent on Writing. Table 5.4 related eighth graders' best narrative 
portfolio writing to their teachers' reports about how much time they spent 
instructing and helping students with their writing in school each week and 
to how much time they expected students to spend on writing homework 
each week. Fourteen percent of the eighth graders who sent in narrative 
pieces had teachers who spent less than 30 minutes per week on in-school 
writing activities; 38 percent spent about 60 minutes; 22 percent spent 
90 minutes; and 26 percent spent two hours or more. Twenty-six percent of 
the students who sent in narrative pieces had teachers who assigned less 
than one hour of writing homework; 34 percent about one hour; 31 percent 
about two hours; and H) percent three hours. 

An analysis of the different amounts of time teachers spent on writing 
in school each week and the level of eighth graders' narrative writing 
revealed no significant differences. Likewise, no differences were found in 
portfolio performance among students whose teachers assigned more 
versus less writing homework. 
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Table 5.4 



Teachers' Reports on 

Time Spent on Writing Each Week in School 
and Out of School, Grade 8 Narrative Writing 



BEST NARRATIVE PORTFOLIO WRITING* 



Overall Low Medium High 

Percentage 1,2 3,4 5,6 



Time Spent on 



Writing in School 
Less Than 30 Minutes 



14(2.2) 
38(2.1) 
22(2.1) 
26 (2.8) 



20 (4.5) 
23 (3.1) 
23 (4.0) 
19(2.7) 



65 (4.5) 
62 (2.4) 
65 (4.2) 
65 (4.1) 



15(4.0) 
16(3.1) 
11 (2.3) 
16(3.5) 



60 Minutes 
90 Minutes 



2 Hours or More 



Time Spent on 
Writing Out of School 
Less Than 1 Hour 

1 Hour 

2 Hours 

3 Hours 



26(2.5) 
34 (2.6) 
31 (2.5) 
10(1.8) 



24 (3.2) 
22 (3.2) 
19(3.1) 
21 (4.0) 



62 (2.6) 
65 (3.9) 
67 (4.0) 
57 (5.4) 



14(3.0) 
13(3.2) 
15(2.5) 
21 (3.8) 



The standard errors of the estimated percentages appear in parentheses. It can be said 
with 95 percent confidence for each population of interest that the value for the whole 
population is within plus or minus two standard errors of the estimate for the sample. 
In comparing two estimates, one must use the standard error of the difference (see 
Procedural Appendix for details). Percentages may not total HU1 percent due to 
rounding error. 

* Low narrative papers were rated as Event Descriptions or Undeveloped Stories; Medium 
narrative papers were rated as Basic Stories or [-a tended Stories; and High nai rative 
papers were rated as Developed Stories or Elaborated Stories 

SOURCE: National Assessment of Educational Progress (NAHM. I W 
Writing Assessment 



Table 5.5 presents information about the time spent on writing 
each week in and out of school for the students who submitted 
informative writing. 

Fifteen percent of the eighth graders who submitted informative pieces 
in their portfolios had teachers who spent less than 30 minutes on writing 
instruction per week; 40 percent spent about 60 minutes; 23 percent spent 
90 minutes; and 23 percent spent two hours or more. Twenty-seven percent 
of these students' teachers reported assigning less than one hour of writing 
homework per week; 35 percent one hour; 28 percent two hours; and 
10 percent three hours. 

An examination of the relationship between the various amounts of 
time spent on writing in school and the level of students' best informative 
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portfolio writing revealed that ii significantly higher percentage of students 
who received two or more hours of writing instruction submitted 
informative papers that received high ratings than students who received 
less than 30 minutes. 

An association was also found between the amount of time eighth 
graders spent out ol s< hool on writing and their level of informative 
portfolio writing. Hist, ol the students who spent about three hours a week 
on writing homework; a significantly lower percentage received low scores 
on their Informative pieces compared with the percentages of students 
who spent one hour ami less than one hour on writing homew ork. Also, 
a significantly higher percentage of these students received high scores on 
their informative pieces compared with the percentages of students who 
spent less than one hour a week on writing homework. 



Table 5.5 

Teachers' Reports on 

Time Spent on Writing Each Week in School 
and Out of School, Grade 8 Informative Writing 



BEST INFORMATIVE PORTFOLIO WRITING* 



Overall 
Percentage 



Low 

1,2 



Medium 
3.4 



High 
5,6 



Time Spent on 
Writing in School 

Less Than 30 Minutes 15 (2.2) 37 (4.5) 60 (4.3) 3 (1 .2) 

60Minutes 40(2.3) 31 (2.1) 62 (2.3) 7(1.5) 

90 Minutes 23 (2.0) 26 (3.9) 65 (3.1) 8 (3.0) 

2 Hours or More 23 (2.3) 26 (3.1) 64 (3.4) 10 (2.2) 

Time Spent on 
Writing Out of School 

Less Than 1 Hour 27 (2.4) 39 (3.5) 58 (3.5) 3 (1 .2) 

1 Hour 35 (2.6) 29 (27) 64 (2.5) 7 (1 .2) 

2 Hours 28 (2.6) 25 (2.8) 66 (2,9) 9 (1.5) 

3 Hours 10 (1.8) 16 (4.3) 62 (4.2) 22 (5.4) 



The standard errors of the estimated percentages appear in parentheses. It can be said 
with 95 percent confidence for each population of interest that the value for the whole 
population is within plus or minus two standard errors of the estimate for the sample. 
In comparing two estimates, one must use the standard error of the difference (see 
Procedural Appendix for details). Percentages may not total 100 percent due to 
rounding error. 

* Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; and High 
informative papers were rated as Developed Discussions or Elaborated Discussions. 

SOUKCK: National Assessment of Educational Progress (NAHP), 1992 
Writing Assessment 
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Second, in considering the students who spent about two hours a week 
on writing homework, a significantly lower percentage received low scores 
on their informative pieces compared with the percentages of students who 
spent loss than one hour on writing homework. Also, a significantly higher 
percentage of these students received high scores on their informative pieces 
compared with the percentages of students who spent less than one hour a 
week on writing homework. 

Thus, for narrative writing there appeared to be little relationship 
between the amount of time spent in school and out of school on writing 
and the level of students' portfolio pieces, but for informative writing there 
was a relationship between the amount of time eighth graders spent on 
writing — both in school and on writing homework — and the level of their 
best portfolio pieces. 

Length and Frequency of Writing Assignments. Eighth-grade teachers 
were also asked how often they gave students assignments of varying 
lengths. Tables 5.6 and 5.7 present information about how often the eighth 
graders in this study were assigned papers of short (1-2 paragraphs), 
medium (1-2 pages), or long (3 or more pages) length. 

For the students who submitted narrative portfolio pieces, the majority 
of their teachers assigned papers 1-2 paragraphs long at least once a week 
(82 percent); 1-2 pages long once or twice a month (55 percent); and 3 or 
more pages never or hardly ever (54 percent). 

The level of narrative portfolio papers is similar for students assigned 
1-2 paragraphs and 3 or more pages. However, a significantly higher 
percentage of students who were never or hardly ever given assignments 
of 1-2 pages in length received low scores, compared to students who were 
given assignments of this length once or twice a month and at least once 
a week. Similarly, a significantly higher percentage of students who were 
assigned papers of 1-2 pages in length at least once a week and once or 
twice a month received high scores compared with those who were never 
or hardly ever assigned papers of this length. 
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Table 5-6 



Teachers' Reports on How Often They Assign 
Papers of Varying Lengths, Grade 8 Narrative Writing 

BEST NARRATIVE PORTFOLIO WRITING* 
Ovarii) Low Midlum High 

Percentages 1,2 3,4 5,6 



1 - 2 Paragraphs 

At Least Once a Week 82 (2.8) 21 (2.1 ) 66 (2.4) 1 3 (1 .6) 

Once or Twice a Month 16 (2.9) 22 (3.0) 66 (3.6) 1 2 (2.8) 

Never or Hardly Ever 2 (1.0) * * * »• * * * * 

1 ■ 2 Pages 

At Least Once a Week 37 (2.5) 19 (2.5) 65 (3.0) 16 (2.5) 

Once or Twice a Month 55 (2.8) 21 (2.6) 64 (2.3) 15 (1 .9) 

Never or Hardly Ever 7 (1.7) 38 (5.3) 56 (5.4) 6 (2.1) 

3 or More Pages 

At Least Once a Week 4(1.5) *»* »** »»» 

Once or Twice a Month 41 (2.8) 1 6 (2.8) 67 (2.8) 1 6 (2.3) 

Never or Hardly Ever 54 (2.9) 24 (2.6) 65 (2.6) 1 1 (1 .9) 



The standard errors of the estimated percentages appear in parentheses. It can be said 
with 95 percent confidence for each population of interest that the value for the whole 
population is within plus or minus two standard errors of the estimate for the sample. 
In comparing two estimates, one must use the standard error of the difference (see 
Procedural Appendix for details). Percentages may not total 100 percent due to 
rounding error. 

* Low narrative papers were rated as Event Descriptions or Undeveloped Stories; 
Medium narrative papers were rated as Basic Stories or Extended Stories; and High 
narrative papers were rated as Developed Stories or Elaborated Stories. 

Sample si/e Insufficient to permit reliable estimates. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 



Table 5,7 presents the results for the students who submitted 
informative portfolio pieces. As with those submitting narrative papers, 
the majority had teachers who assigned papers 1-2 paragraphs long at least 
once a week (80 percent); 1-2 pages long once or twice a month (51 percent); 
and 3 or more pages never or hardly ever (56 percent). 

No significant differences were found in the level of students' portfolio 
writing between students who were assigned 1-2 paragraphs frequently 
(at least once a week), sometimes (once or twice a month), and rarely (never 
or hardly ever). However, a significantly higher percentage of students who 
were never or hardly ever given assignments of 1-2 pages in length received 
low scores, compared to students who were given assignments of this 
length once or twice a month or at least once a week. Likewise, a 
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significantly higher percentage of students who were assigned papers of 
1-2 pages in length at least once a week and once or twice a month received 
medium scores compared with those who were never or hardly ever 
assigned papers of this length. Also, a significantly higher percentage of 
students whose teachers never or hardly ever made assignments of 3 or 
more pages in length received a low rating on their informative papers, 
compared with those whose teachers assigned papers of this length once 
or twice a month, 

Thus, for both narrative and informative writing, the frequency with 
which teachers assigned papers of moderate length was associated with the 
level of students' portfolio submissions. Those who received assignments of 
1-2 pages in length at least once or twice a month outperformed those who 
were never or hardly ever given assignments of this length. 



Table 5.7 

Teachers' Reports on How Often They Assign 

Papers of Varying Lengths, Grade 8 Informative Writing 

BEST INFORMATIVE PORTFOLIO WRITING* 





Overall 
Percentages 


Low 
1,2 


Medium 
3.4 


High 
5,6 


1 - 2 Paragraphs 
At Least Once a Week 
Once or Twice a Month 
Never or Hardly Ever 


80 (3.4) 
18(3.2) 
2(0.8) 


29(1.8) 
37 (3.2) 
• • * 


64(1.8) 

57 (2.9) 
* * * 


7 (0.8) 
6(2.3) 

* * * 


1 - 2 Pages 
At Least Once a Week 
Once or Twice a Month 
Never or Hardly Ever 


35 (2.7) 
51 (3.5) 
13(3.4) 


25 (2.9) 
30 (2.4) 
48 (4.4) 


67 (2.7) 
63 (2.1) 
47 (3.5) 


8(1.8) 
7(1.0) 
5(2.4) 


3 or More Pages 
At Least Once a Week 
Once or Twice a Month 
Never or Hardly Ever 


4(1.0) 
40 (3.2) 
56 (3.2) 


* • • 

24 (2.4) 
36 (2.6) 


* * * 

65 (2.2) 
58 (2.2) 


* * * 

11(2.4) 
5(1.1) 



The standard errors of the estimated percentages appear in parentheses. It can be said 
with 95 percent confidence for each population of interest that the value for the whole 
population is within plus or minus two standard errors of the estimate for the sample. 
In comparing two estimates, one must use the standard error of the difference (see 
Procedural Appendix for details). Percentages may not total 100 percent due to 
rounding error. 

* Low informative papers were rated as I i stings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; and High 
mlormative papers were rated as Developed Discussions or Elaborated Discussions 

* M Sample si/e iiisiiflu ietit lo permit reliable estimate. 

M HMUJ- National Assessment ot kiucational Progress (NAliP), W2 
Willing Assessment 
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Teachers Use of Process Writing Approaches. The teachers of the 
eighth graders in this study were asked to what degree they employed 
process approaches to writing instruction. Table 5.8 presents the results 
of this inquiry. 



Table 5.8 

Teachers' Reports on Their Use of 

Process Approaches to Writing Instruction, Grade 8 



BEST PORTFOLIO SCORES" 



Overall 
Percentages 



Low 

1.2 



Medium 
3,4 



High 
5,6 



Narrative 

Central to Instruction 75(2.8) 21 (2.7) 64(2.7) 15(1.6) 

Supplement to instruction 22 (2.4) 23 (3.6) 64 (4.3) 1 3 (2.2) 

NotUsed 3(1.1) 

Informative 

Central to Instruction 75(2.6) 30(2.2) 61 (1.9) 9(1.3) 

Supplement to Instruction 23(2.4) 28(3.9) 67(4.1) 5(1.2) 

NotUsed 2(0.7) 



The standard errors of the estimated percentages appear in parent host's. It am be said 
with yf> percent confidence fur each population of interest that the value for the whole 
population is within plus or minus two standard errors of the estimate for the sample. 
In comparing two estimates, one must use the standard error of the difference (sec 
Procedural Appendix for details). Percentages may not total 100 percent due to 
rounding error. 

* Low narrative papers were rated as Event Descriptions or Undeveloped Stones; 
Medium narrative papers were rated as Basic Stories or Extended Stories; and 
High narrative papers were rated as Developed Stories or Elaborated Stories. Low 
informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rateil as Undeveloped Discussions or Discussions; and High 
informative papers were rated as Developed Discussions or Elaborated Discussions. 

** Sample si/e insufficient to permit reliable estimate. 

SOURCE: National Assessment of Educational Progress (NAEP), 1W2 
Writing Assessment 



Three-quarters of the teachers of students who submitted narrative 
and informative writing reported that process approaches were central 
to their instruction; 22 and 23 percent said that process approaches were 
supplemental to their instruction; and only 3 and 2 percent said they did not 
use process approaches to writing instruction. Little difference was found in 
the levels of performance between students whose teachers said they used 
process approaches as either central or supplemental to their instruction. 
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Ongoing Use of Portfolios in the Classroom. Students' reports about the 
ongoing use of classroom writing portfolios were examined in relation to 
their narrative and informative NAEP portfolio writing. Students at grades 
4 and 8 were asked whether their writing was kept in a portfolio, and their 
responses are presented in Table 5.9. 



Table 5.9 

Use of Classroom Portfolios and 

Students' Best Portfolio Writing, Grades 4 and 8 

BEST PORTFOLIO SCORES* 





Overall 


Low 


Medium 


High 




Percentages 


1,2 


3,4 


5,6 


Writing Kept in Portfolio? 










Grade 4 










Narrative 










Yes 


83(1.5) 


42(1.8) 


55(1.8) 


3(0.7) 


No 


17(1.5) 


53 (4.5) 


46 (4.4) 


1 (0.6) 


informative 










Yes 


80 (1.7) 


60(1.9) 


39 (2.0) 


1 (0.5) 


No 


20 (1.7) 


66 (4.0) 


33 (3.9) 


1(1.1) 


Grade 8 










Narrative 










Yes 


82(1.6) 


21 (2.1) 


64 (2.3) 


15(1.3) 


No 


18(1.6) 


21 (3.4) 


65 (3.8) 


14(3.1) 


Informative 










Yss 


79 (1.7) 


29(1.7) 


64(1.5) 


7(0.8) 


No 


21 (1.7) 


35 (4.3) 


57 (4.2) 


9 (2.0) 



The standard errors of the estimated percentages appear in parentheses. It can be said 
with 95 percent confidence for each population of interest that the value for the whole 
population is within plus or minus two standard errors of the estimate for the sample. 
In comparing two estimates, one must use the standard error of the difference (see 
Procedural Appendix for details). Percentages may not total 100 percent due to 
rounding error. 

• Low narrative papers were rated as Fvent I )esiTiptinns or Undeveloped Stories; Medium 
narrative papers were rated as Basic Stories or Intended Stones; and High narrative 
papers were rated as Developed Stories or Klahorati'd Stories. Low informative papers 
were rated as Listings or Attempted Discussions; Medium informative papers were rated 
as Undeveloped Discussions or Discussions; and I ligh Informative papers were rated as 
Developed Discussions or Elaborated Discussions. 

SOURCE: National Assessment ol I durational Progress (N A VV), 1992 
Writing Assessment 
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The vast majority of students at both grades reported that their 
classroom writing was kept in portfolios. Eighty-three percent of the fourth 
graders who sent in narrative pieces and 80 percent who sent in informative 
pieces reported that their classroom writing was kept in a portfolio. At 
grade 8, 82 percent of the students who sent in narrative and 79 percent 
who sent in informative papers said that they kept their classroom writing 
in portfolios. 

There appears to be little relationship between this instructional 
practice and the level of students 7 NAEP portfolio writing, except for 
fourth-grade narrative writing. At the fourth grade, a significantly higher 
percentage of students who did not keep their classroom writing in 
portfolios received low scores on their narrative writing. This relatively 
low degree of correspondence may have occurred because of the variety of 
portfolio approaches taken by individual teachers. If portfolios are used 
mainly as a way of storing students 7 work, they may have little effect on 
students 7 writing performance. On the other hand, if portfolios are used as 
part of dynamic writing program, where students are writing every day and 
using portfolios to help structure their self-evaluations and the revisions of 
their work, then portfolios may be more likely to have a positive influence 
on students 7 writing performance. 

Writing Ability Level. Eighth-grade teachers were asked to report on the 
writing ability level of the students in their classes. Table 5.10 presents the 
results of this inquiry for the eighth graders who submitted narrative or 
informative portfolio pieces. 
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Table 5.10 



Teachers' Reports on Writing 

Ability Level of Class and Best Portfolio Scores, Grade 8 



BEST PORTFOLIO SCORES* 



Writing 


Overall 


Low 


Medium 


High 


Ability Level 


Percentages 


1,2 


3,4 


5,6 


Narrative 










High 


15(2.0) 


12(3.4) 


63 (4.6) 


25 (4.0) 


Average 


31 (2.5) 


22 (3.4) 


60 (3.2) 


18(1.9) 


Low 


16(2.2) 


39 (4.7) 


54 (4.9) 


7 (2.4) 


Mixed 


39 (2.5) 


18(2.7) 


71 (3.0) 


11 (2.0) 


Information 










High 


12(1.6) 


20 (3.5) 


65 (4.8) 


15(4.5) 


Average 


37 (2.6) 


25 (2.5) 


66 (2.6) 


8(17) 


Low 


17(1.6) 


47 (4.6) 


52 (4.6) 


1 (0.5) 


Mixed 


34 (2.7) 


29 (3.2) 


64 (3.0) 


7(1-3) 



Thi' standard mors of the estimated pen entagcs appear in p.ironllirscs. It can be said 
with C W percent contidcm e lor cu h population of interest that tin* value for the whole 
population is within plus or minus two standard errors of the estimate for the sample, 
in comparing two estimates, one must use the standard error of the difference (see 
Procedural Appendix for details). Pen/entases may not total KM) percent due to 
rounding error. 

* Low narrative papers were rated as Event Descriptions or Undeveloped Stories; Medium 
narrative papers were rated as Basic Stories or Extended Stories; and High narrative 
papers were rated as Developed Stories or Elaborated Stories. Low informative papers 
were rated as Listings or Attempted Discussions; Medium informative papers were rated 
as Undeveloped Discussions or Discussions; and High informative papers were rated as 
Developed Discussions or Elaborated Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP), P>92 
Writing Assessment 

Fifteen percent of the students who submitted narrative portfolio 
pieces came from high-ability classrooms, 31 percent from average-ability 
classrooms, 16 percent from low-ability classrooms, and 39 percent from 
mixed-ability classrooms. A similar pattern was found for eighth graders 
who submitted informative writing. Twelve percent were from high-ability 
classes, 37 percent from average-ability classes, 17 percent from low-ability 
classes, and 34 percent from mixed-ability classes. 

There was an association between students' ability level (as reported 
by their teacher) and the scores they received on their best narrative writing. 
First, a significantly higher percentage of students from low-ability classes 
received low ratings on their narrative pieces compared with those from 
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high-, average-, and mixed-ability classes. Second, a significantly higher 
percentage of students from mixed-ability classes received medium ratings 
compared with students from low-ability classes. Lastly a higher percentage 
of students from high-ability classes received high ratings on their narrative 
papers compared with students from low- and mixed-ability classes. 

An association also was found between students' ability level and 
their best informative portfolio scores. First, a significantly higher 
percentage of students from low-ability classes received low scores on 
their informative papers compared with students from high-ability classes. 
Also, a higher percentage of students from average-ability classes received 
medium ratings on their papers compared with students from low-ability 
classes. And lastly, a higher percentage of students from high-ability classes 
had informative portfolio papers rated as high compared with students 
from low-ability classes. 

Thus, for both narrative and informative writing submitted by eighth 
graders, the level of their writing was associated with the ability level of 
their classes. 

Summary 

The types of activities to which students responded in generating their 
narrative and informative portfolio pieces were related to the level of their 
writing. At the fourth grade, a higher percentage of papers that were written 
as part of integrated writing activities received medium ratings, whereas a 
higher percentage of papers that were written in response to other types 
of activities received low ratings. For eighth-grade informative writing, a 
higher percentage of papers that were content reports received medium 
and high ratings compared with papers written in response to other types 
of activities. 

Among students whose teachers used various instructional 
characteristics, it appc-ars that students who spent more time on writing, 
both in school and out of school, performed better on their portfolio writing. 
Also, students who were asked to write papers of medium (1-2 pages) and 
long (3 or more pages) lengths at least once or twice a month performed 
better on their portfolio writing than did those who rarely or never were 
asked to do so. 

Most of the teachers (98 percent) of the eighth graders participating 
in this study reported that they used the process approach to writing 
instruction, as either a supplement to their program or central to their 



instruction. Also, at least 79 percent of the fourth and eighth graders said 
that their writing was kept in portfolios. At the fourth grade, more students 
who did not keep their classroom writing in portfolios received low ratings 
on their NAEP narrative portfolio writing. 

In addition, the writing ability levels of eighth graders, as reported by 
their classroom teachers, were associated with the level of their portfolio 
writing, with students from high-ability classes outperforming those from 
low-ability classes. 
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Comparing Students' Best Portfolio Writing 
with Their Best NAEP Assessment Writing 



Introduction 

In this chapter, students' performance on their portfolio writing is 
compared with their writing on the main portion of the 1992 NAHP 
writing assessment. As presented in the first part of this report, the NAHP 
writing assessment consisted of a set of writing tasks to which students 
had 25 or 50 minutes to respond. These tasks included a mix of narrative, 
informative, and persuasive topics. 

This comparison is made in light of concerns among educators about 
the appropriateness of various methods of assessment for accurately and 
fairly evaluating students' writing. As was discussed in Part I, changes in 
approaches to writing instruction over the past thirty years have resulted 
in the development of new methods of assessment, such as portfolios. 
The effectiveness of various methods of assessment is an issue of debate 
among writing educators. Some educators feel that the use of more 
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traditional methods of assessment do not represent authentic writing 
situations and, therefore, do not provide students with opportunities to 
truly demonstrate their writing abilities. Other educators are concerned 
that assessments where students submit writing that was written under 
various conditions lack a common point of comparison and represent 
evaluations of instructional programs as much as of students' abilities. 
This study presents a unique opportunity to compare the performance 
of students under both conditions. 

In order to compare students' portfolio and assessment writing, the 
type of writing students submitted was matched with the type of writing 
they performed on the assessment. Therefore, students' best narrative 
portfolio writing was compared to their best narrative assessment writing 
and their jest informative portfolio writing was compared to their best 
informative assessment writing. Thus, the number of students in this 
comparison is somewhat less than the overall group of students who 
submitted narrative and informative portfolio papers, since students did 
not always submit the same kind of task in their portfolios as they were 
asked to write for the assessment. 

Table 6.1 presents the number of students with both main assessment 
and portfolio scores in the same domain. For narrative writing, 650 fourth 
graders and 496 eighth graders had narrative assessment scores and 
submitted narrative portfolio papers. For informative writing, 723 fourth 
graders and 496 eighth graders responded to informative assessment tasks 
and submitted informative portfolio papers. (The number of students in the 
tables in this chapter are weighted to reflect the national population in each 
grade and then scaled back to the sample size.) 

The portfolio performance of this smaller group of students is similar 
to that of the larger group. Among the fourth graders who had narrative 
portfolio and narrative assessment scores, 43 percent received low ratings 
on their narrative portfolio papers; 55 percent received medium ratings; and 
2 percent received high ratings. For grade 8, 18 percent received low scores 
on their narrative portfolio pieces; 66 percent received medium scores; 
and 16 percent received high scores. 

Among the fourth grades who submitted informative portfolio writing 
and also responded to informative assessment tasks, 61 percent received 
low ratings on their informative portfolio papers; 37 percent received 
medium ratings; and only 1 percent received high ratings. At the eighth 
grade, 31 percent received low scores on their informative portfolio papers; 
61 percent received medium ratings; and 9 percent received high ratings. 
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Table 6.1 



Number of Students With Both Main Assessment 
and Portfolio Scores in the Same Domain 



Overall 



PERCENTAGES FOR PORTFOLIO SCORES* 
Low Medium High 

1,2 3,4 5,6 



Narrative 
Grade 4 
Grade 8 



N.650 
N = 496 



43(1.6) 
18(2.1) 



55(1.8) 
66 (2.4) 



2 (0.7) 
16(1.9) 



Informativo 
Giado 4 
Giatlo 8 



N*723 
N*496 



6i (2.4) 
31 (1.8) 



37 (2.5) 
61 (1.8) 



1 (0.6) 
9(1.1) 



tin' st.mihiht errors of the estimated percentages appear in parentheses It can be 
said with *» r i peiienl confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
loi the sample In comparing two estimates, one must use the standard error of 
the dltlcten< e (see Procedural Appendix for details). Percentages may not total 
1U0 pen cut due In rounding error. 

4 I m\\ n»n lathe papets were rated as Event Descriptions or Undeveloped Stories; 
Medium 11,111, ilive papers were rated as Basic Stories or Extended Stories; and 
I Itglt narrative papers were rated as Developed Stories or Elaborated Stories. 
1 oe« inlunnallve papets were raled as Listings or Attempted Discussions; Medium 
mint mails e papets weie lated as Undeveloped Discussions or Discussions; 
and 1 Itgh mloiinattve papers were rated as Developed Discussions or 
1 Itllmialed 1 >1M usmoiis 

•it »l »Ht I National Assessment nt 1 dmattnnal Progress (NAEP), 1992 
Witling Aim inent 



llolh the NAI I 1 writing assessment and the NAEP portfolio study 
storing systems employed six-level guides which focused on students' 
abilities to develop narrative, informative, and persuasive pieces of 
writing. I lowever, different scoring rubrics were used to evaluate students' 
assessment writing and their portfolio writing; therefore, these scoring 
systems are not equivalent. Considering the classroom context for 
producing the portfolio papers, somewhat more stringent criteria were 
applied to these papers. Moreover, the assessment scoring guides were 
designed to evaluate students' responses to specific prompts or topics, 
while the portfolio guides were more generic. 

The assessment scoring guides were designed to evaluate first-draft 
writing under timed conditions. These guides were written to capture a 
wide range of students' assessment writing. This involved describing very 
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limited levels of response, since some students had difficulty responding 
with an extensive piece of writing in an assessment situation. Also, the time 
limit (25 minutes) influenced the degree of development and elaboration 
that students' could achieve. 

The portfolio scoring guides were developed to evaluate longer, more 
extensive pieces of work, written over a longer period of time, with the aid 
of a variety of resources. These guides did not have to include the minimal 
responses that were found in the assessment scoring guides, since students 
had selected their best writing to submit. Also, because students' portfolio 
writing often involved more preparation (pre-writing activities) and 
development (revision), theoretically there were no limits to the degrees 
of development and elaboration students could achieve. 

In comparing students 7 performance on the main NAEP writing 
assessment and on their portfolio writing, it could be expected that 
correlation between these modes of assessment would not be strong. 
While some students might perform similarly on both types of assessment, 
others might perform better on the assessment and others on their portfolio 
writing. Some students might perform better on a timed assessment, where 
they find the topic interesting and the assessment context challenging. Other 
students might perform better on their classroom-based writing, where 
they are able to choose their own topics, consult with their peers and their 
teachers, and rewrite their papers several times. Thus, these two types of 
writing assessments provide us with information about how students write 
under very different conditions. 



Fourth Graders 

Narrative Writing. As Table 6.2 shows, more than half of the 27 percent 
of fourth graders who received a low score on the NAEP narrative writing 
assessment also received a low score on their school-based narrative 
writing. Forty-four percent of the students who received low ratings on 
their assessment writing received medium ratings on their narrative 
portfolio writing. 
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Table 6.2 

Comparisons of Best Narrative Portfolio Scores 

and Best Narrative NAEP Assessment Scores, Crack 4 

BEST NARRATIVE PORTFOLIO SCORES* 

Low Medium High 
Overall 1,2 3,4 5,6 

Best Narrative 



Assessment Scores 



Low 


27 (1.9) 


56 (3.3) 


44 (3.3) 


0 (0.3) 


(1,2) 


N.175 


N - 98 


N = 76 


N = 1 


Medium 


68 (1.9) 


39 (2.4) 


58 (2.5) 


3(1.0) 


(3.4) 


N-440 


N = 172 


N = 257 


N = 11 


High 


5(1.0) 








(5,6) 


M-35 


* * « 


* « * 


* * * 



"flu 1 standard errors of the estimated percentages appear in parentheses. It can be 
sahl with *W percent confidence for each population of interest that the value for 
tlu 1 whole population is within plus or minus two standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of 
tht» differeiue (sec Procedural Appendix for details). Percentages may not total 
HHI peitent ilui* t«i rounding error. 

* I ow narrative papers were rated as Event Descriptions or Undeveloped Stories; 
Medium nairative papers were rated as Basic Stories or Extended Stories; and 
I II nil narrative papers were rated as Developed Stories or Elaborated Stories. 

M * Sample Hl/e lie nlficlent to permit reliable estimates. 

SI )l HU E National Assessment ol Educational Progress (NAEP), 1992 
Writing Assessment 

On the other hand, the great majority of the fourth graders 
(68 percent) received medium scores on their narrative assessment writing, 
and 39 percent of these students received low scores on their narrative 
portfolio writing, while 58 percent also received medium scores. Too few 
students received high scores on their narrative assessment writing 
(5 percent) to permit further analysis. 

Informative Writing. Table 6.3 displays the fourth-grade informative 
results. Most of the fourth graders — 78 percent — received medium 
scores on their informative assessment writing. Among these fourth graders, 
60 percent received low scores on their informative portfolio writing and 
only 39 percent received medium scores on their portfolio writing. Almost 
three-quarters (73 percent) of the few students who received low scores 
on their informative assessment writing also received low scores on their 
informative portfolio writing. The rest {27 percent) received medium scores 
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on their portfolio writing. Out of the few fourth graders who received high 
scores on their best informative assessment writing, 57 percent received low 
scores and 40 percent received medium scores on their informative portfolio 
writing, and 3 percent of the remaining students received a high score on 
their portfolio writing. 

As a means for measuring the degree of correlation between students' 
performance under the two types of situations — assessment writing and 
classroom-based writing — a Pearson r correlation was calculated. The 
correlation for fourth-grade narrative writing was .20 and for informative 
writing it was .09. Both of these correlations are very low. 2S 



Table 6.3 

Comparisons of Best Informative Portfolio Scores and 
Best Informative NAEP Assessment Scores, Grade 4 



BEST INFORMATIVE PORTFOLIO SCORES* 

Low Mtdium High 
Overall 1,2 3,4 5,6 



Best Informative 



Assessment Scores 



Low 


11(1.2) 


73 (5.7) 


27 (5 <) 


0 (0 0) 


(1.2) 


N = 82 


N = 60 


N = 22 


N 0 


Medium 


78(1.5) 


60 (2 9) 


39 (? 9) 


1 (fl (1) 


(3.4) 


N = 562 


N = 337 


l\U?1'/ 


N-fl 


High 


11(1.3) 


57 (6.3) 


40 (0 G) 


3(2 9) 


(5.6) 


N = 79 


N = 45 


N = 32 


N 3 



The standard errors of the estimated percentages appear in parentheses It can he 
said with 95 percent confidence for each population of interest that the value tor 
the whole population is within plus or minus two standard errors ol the estimate 
for the sample. In comparing two estimates, one must use the standard error of 
the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 

* Low informative papers were rated as Listings or Attempted Discussions; 
Medium informative papers were rated as Undeveloped Discussions or 
Discussions; and High informative papers were rated as Developed Discussions 
or Elaborated Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 



? * A test for statistical significance was conducted for these correlations and neither correlation was 
significantly different from 0. 
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Eighth Graders 

Narrative Writing. As Table 6.4 shows, most students — 71 percent — 
received medium ratings on their assessment writing. Sixty-eight percent of 
these also received medium ratings on their portfolio papers, but 17 percent 
received low and 15 percent received high portfolio ratings. Among the 
20 percent who received low ratings on their narrative assessment writing, 
22 percent also received low ratings on their narrative portfolio writing, 
while 67 percent received medium ratings, and 11 percent received high 
ratings. Only 9 percent of the eighth graders (46 students) who received 
high scores on their narrative assessment writing also submitted narrative 
portfolio writing. Twenty-eight percent of these students also received high 
scores on their portfolio writing, but 19 percent received low scores and 
53 percent received medium scores. 



Table 6.4 

Comparisons of Best Narrative Portfolio Scores and 
Best Narrative NAEP Assessment Scores, Grade 8 

BEST NARRATIVE PORTFOLIO SCORES* 

Low Medium High 

Overall 1,2 3,4 5,6 

Best Narrative 



Assessment Scores 



Low 


20 (1.6) 


22 (3.6) 


67 (3.6) 


11 (3.3) 


(1.2) 


N = 99 


N = 21 


N = 67 


N = 11 


Medium 


71 (2.0) 


17(2.3) 


68 (3.0) 


15(2.4) 


(3.4) 


N = 351 


N = 59 


N = 238 


N = 53 


High 


9(1.0) 


19 (4.7) 


53 (6.5) 


28 (6.4) 


(5.6) 


N = 46 


N = 9 


N = 24 


N = 13 



I ln> Hl.iml.ml errors of the estimated percentages appear in parentheses. II can be 
••aitl with { > r i percent confidence for each population of interest that the value for 
Ihe whole population is within plus or minus two standard errors of the estimate 
lor the sample In comparing two estimates, one must use the standard error of 
the dillereuic (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 

* I ow nan alive papers were rated as l-vcnl Descriptions or Undeveloped Stones; 
Medium narrative papers were rated as Basic Stories or iMemlcd Stories; and 
I llgh n.uralive papers were rated as Developed Stories or Hahniatcd Stories 

Si UHU I- National Assessment ol I durational Progress (NAM 1 ). I'«? 
Wi lling Assessment 
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Informative Writing. Table 6.5 provides the results for the informative 
domain for eighth grade. Again most students — 79 percent — received 
medium ratings on their informative assessment writing. Of these, 
61 percent also received medium ratings on their informative portfolio 
writing. However, 30 percent of these students received low scores and 
8 percent received high scores on the portfolio papers. 

Forty-seven percent of the few eighth graders who submitted 
informative papers and received low ratings on their informative 
assessment writing also received low ratings on their informative portfolio 
writing, while 52 percent of these students received medium portfolio 
ratings and 2 percent high ratings. Only 13 percent received high scores on 
their informative assessment writing and submitted informative portfolio 
papers. Of these students, only some (14 percent) also received high scores 
on their portfolio writing. Twenty percent received low scores and 
65 percent received medium scores. 

A Pearson r correlation was also calculated as a way of measuring 
the degree of correlation between eighth graders' performance on their 
assessment writing and their portfolio writing. The correlation for eighth- 
grade narrative writing was .09 and for informative writing it was .15. 
Both of these correlations are very low. 26 



!h A test for statistical significance was conducted for these correlations and neither correlation was 
significantly different from 0. 
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Table 6.5 

Comparisons of Best Informative Portfolio Scores and 
Best Informative NAEP Assessment Scores, Grade 8 

BEST INFORMATIVE PORTFOLIO SCORES* 
low Medium High 
Overall J\£ ZA 5,6 

Best Informative 



Assessment Scores 



Low 
(1.2) 


9(1.2) 
N = 60 


47 (6.4) 
N = 28 


52 (6.7) 
N = 31 


2(1.4) 
N = 1 


Medium 
(3.4) 


79 (1.8) 
N=»551 


30(1.9) 
N = 167 


61 (2.0) 
N = 337 


8(1.4) 
N = 46 


High 
(5,6) 


13(1.2) 
N*87 


20(3.8) 
N = 18< 


65 (5.4) 
N = 57 


14(4.1) 
N = 12 



The standard errors of the estimated percentages appear in parentheses. It can be 
said with 95 percent confidence for each population of interest that the value for 
the whole population is within plus or minus two standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of 
the difference (see Procedural Appendix for details). Percentages may not total 
100 percent due to rounding error. 
* Low informative papers were rated as Listings or Attempted Discussions; Medium 
informative papers were rated as Undeveloped Discussions or Discussions; and 
High informative papers were rated as Developed Discussions or Elaborated 
Discussions. 

SOURCE: National Assessment of Educational Progress (NAEP), 1992 
Writing Assessment 

Summary 

The comparison of fourth graders' best narrative portfolio writing with 
their best narrative NAEP assessment writing revealed that the majority of 
students who received low scores on their assessment writing also received 
low scores on their portfolio writing. Likewise, the majority of students who 
received medium scores on their assessment writing also received medium 
scores on their portfolio papers. 

However, for informative writing, while the majority of fourth graders 
who received low scores for their assessment writing also had low ratings 
on their portfolio papers, the majority who received medium ratings 
on their informative assessment writing received low scores on their 
informative portfolio papers. Among the few students who received high 
ratings on their assessment writing, over 50 percent received low ratings 
and 40 percent received medium ratings on their portfolio scores. 
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The pattern for eighth-grade narrative writing is different from that of 
fourth-grade, While the majority of students who received medium scores 
on their assessment writing received medium scores on their portfolio 
papers, the majority of students who received low scores and the majority 
who received high scores on their NAEP assessment also received medium 
ratings on their portfolio papers. 

For eighth-grade informative writing, the majority of the students 
who received low scores on their assessment papers received medium 
scores on their portfolio submissions. Also, the majority of students who 
had high scores on their assessment writing received medium scores on 
their portfolio papers. However, the majority of students who scored at 
the medium level on their NAEP assessment also received medium scores 
on their portfolio writing. In general, the correlation between students' 
portfolio and assessment writing was low. 

in conclusion, both ways of assessing students' writing have advantages 
and limitations. More traditional forms of direct writing assessment, such as 
the NAFP writing assessment, employ a common writing task and a time 
limit. This yields a standard means for comparing students' performance. 
However, these assessments are hampered by the limited time available to 
students to write and revise their work; the lack of resources available; and 
the lack of time for peer and /or teacher conferencing. Traditional types of 
assessment yield a snapshot of students' abilities to write unaided, first- 
draft papers on an assigned topic, rather than an in-depth view of students' 
writing processes. 

In contrast, portfolio assessment systems, like the one employed 
by NAEP, provide rich information about the processes in which students 
engage. However, they are hampered by the quality of the classroom 
activities students are responding to and by the amount of writing students 
have to choose from when making their portfolio selections. Some students 
who participated in the NAEP portfolio study wrote in their letters that they 
had only one good piece to submit, so they submitted less than stellar 
papers in other genres in order to comply with our request for three papers, 

Assessing students' writing abilities is a complex endeavor. Traditional 
forms of writing assessment, when combined with portfolio assessment 
projects, yield valuable and complementary information about the range 
of students' writing performance. More traditional forms of assessment 
provide a breadth of information about students' abilities to perform 
a range of writing tasks, while portfolio assessment provides in-depth 
information about the writing processes in which students engaged. The use 
of both portfolio and traditional modes of assessment in concert provides 
educators with rich, detailed portraits of students' writing abilities. 



132 

ERIC MO 



APPENDICES 



133 141 

ERIC 



Appendix A 

Summary of State Writing 
Assessment Programs 



ALABAMA 

Randall Gull 205-242-8038 
Ann Moody 205-242-8038 
Alabama Education Department 
50 North Ripley Street — Room 3304 
Montgomery, AL 36104-3833 

Alabama is assessing writing performance in grades 5 and 7 using 
descriptive, narrative, and expository modes (with the addition of the 
persuasive mode in grade 7). They have developed a "utilization guide" 
describing how to use the results of these assessments. They have also 
developed an integrated reading and writing assessment using "real 
life" situations at grade 2 statewide. Integrated reading and writing 
performance assessments at grades 5 and 7 may be developed 
in the future. 
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ALASKA 

Bob Silverman 907-465-8680 
Alaska State Department of Education 
801 West Tenth Street 
Suite 200 

Juneau, AK 99801-1894 

Alaska has just completed a four-year pilot project in portfolio assessment 
supported by grants at the local level. Reports on this project are available 
to other states. As a result, one elementary school district requires language 
arts portfolios in grades 1 and 2. This district has produced an elementary 
portfolio handbook which is being marketed nationally. The use of 
student-led conferences also has been part of these pilot efforts. The state 
has developed statewide student performance standards which are in the 
final stage of board approval. These standards have initiated discussion on 
statewide portfolio assessment for district use. 

ARIZONA 

Muriel Rothman 602-542-3537 
Arizona Education Services Department 
1535 West Jefferson 
Phoenix, AZ 85007 

Arizona conducts a statewide writing assessment in grades 3, 8, and 12 
in which 130,000 students are involved. It is part of a statewide process 
of program evaluation. Local districts use it to evaluate themselves. The 
assessment was developed by an outside contractor, Riverside. It is a 
thematic assessment, beginning with a reading activity that expands 
into a math activity and is then tied to writing. The writing question is 
genre-specific. There is a pre-writing activity, a rough draft and a final 
draft. A four-point rubric is used to evaluate mechanics and content. 
Portfolio assessment is not employed on the state level, but is used 
extensively locally. 

ARKANSAS 

Dave Westmoreland 501-682-4206 
Arkansas Education Department 
Capitol Mall 
Building 4 

Little Rock, AR 72201-1071 

Recently, a writing assessment field test was conducted of fifth, ninth 
and eleventh graders. Students were f»ivun one hour to write to a specific 
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prompt. Content, style, sentence formation, usage, and mechanics each were 
scored on a four-point scale. Arkansas teachers were specifically trained to 
administer this test. The assessment is used to improve and influence 
writing in the curriculum in all content areas. 

Although pleased with the current writing assessment, Arkansas is 
considering changes in the future which would involve writing developed 
over time, the use of process writing, or a portfolio. 

CALIFORNIA 

Jill Wilson 916-657-4262 

California Education Department 

721 Capitol Mall, P.O. Box 94472, 4th Floor CLAS 

Sacramento, CA 94244-2720 

California is in the second year of administering the newly mandated 
California Learning Assessment System(CLAS). The purpose of CLAS is 
to assess student performance and to designate specific standards which 
will help students improve their performance. Under CLAS, the writing 
assessment will be administered in grades 4, 8, and 10. Students respond to 
different types of writing tasks at each grade level. School-level scores are 
reported at all grade levels; in 1994 individual scores will be reported at 
grade 8 only. 

The development of a portfolio assessment for all three grade levels is 
in the pilot stage. 

COLORADO 

Don Watson 303-866-6854 
Colorado Education Department 
201 East Colfax Avenue 
Denver, CO 80203-1799 

Colorado is in a transitional stage due to recently enacted state legislation 
which mandates standards in six subject areas, including writing. The 
current program involves a triennial assessment of grades 4, 8, and 10 in 
descriptive and persuasive writing tasks. Student performance is scored 
on a primary and secondary trait lour-point scale by an independent 
contractor. Participation in the assessment is by random selection of schools. 
Non-selected schools may choose to participate by paying essential costs. 

The function of the assessment is to report on student achievement to 
the legislature and the public. Individual school districts may also use the 
results diagnostically. 
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CONNECTICUT 

Pat Brandt 203-566-4001 
Connecticut State Board of Education 
165 Capitol Avenue 
Hartford, CT 06145 

Each year, as part of the Connecticut Mastery Test (CMT), the grade 4, 6, and 
8 students produce a writing response. The students are allotted 45 minutes 
for a response which is then scored holistically. The entire CMT has recently 
undergone an extensive review process which resulted in clearer prompts 
and guidelines for students. The scoring scale was also changed from four 
points to six points. Scorers are trained according to anchor/ training sets 
developed by Connecticut educators. Each paper is scored twice and the 
scores are added for a total-student score from 2 to 12. Results are given 
on an individual student basis, aggregated up through state level data. 
Connecticut State Department content consultants advocate portfolios for 
all students, but the state does not do a large-scale assessment of such. 

DELAWARE 

Larry Gabbert 302-739-3902 
Delaware Public Instruction Department 
P.O. Box 1402 
Townsend Building 
Dover, DE 19903-1402 

An interim assessment program is under way for all students in grades 

3, 5, 8, and 10 in reading, writing, and math. There are 7,000 - 8,000 students 

per grade level. 

This assessment is part of an accountability program in which schools 
will be held accountable, not students. Students will provide three writing 
samples. There will be two 60-minute stand-alone exercises with standard 
prompts for different types of writing. The third writing opportunity will 
be an open-ended question as part of the reading assessment. 

FLORIDA 

Lani Dunhorn 904-488-8 198 
Florida Education Department 
The Capitol PL-08 
Tallahassee, FL 32399 

Florida is in the developmental stage of a school-level accountability 
program and anticipates the increased use of alternative assessment 
strategies at school and state levels. 
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GEORGIA 

Sandra Baxley 404-656-2668 
Georgia Education Department 
205 Butler Street 
Twin Towers E-Room 2066 
Atlanta, GA 30334 

Writing assessment is conducted in grades 3, 5, 8, and 11. The writing 
assessment was developed by groups of classroom teachers. In grade 3, the 
assessment is a "portfolio" type, in that the teachers select multiple samples 
of the student's work and assesses them according to the guidelines. 
An individual report is given to the parent, while the state receives a 
breakdown of the number of students at each developmental stage. 

Grades 5, 8, and 11 receive a prompt during a 90-minute instructional 
period in which 45 minutes are allocated for writing. These writing samples 
are scored by Test Scoring and Reporting Services of the University of 
Georgia. Trained raters use a developmental stages scoring guide. 
Reporting is on an individual, school, and system level. For eleventh 
graders (65,000 students), this is a "high stakes" test which must be 
passed to meet graduation requirements. 

HAWAII 

Pat Sasaki 808-586-3285 
Hawaii Education Department 
P.O. Box 2360 
Honolulu, HI 96804 

For the past 5 to 7 years, Hawaii has employed the Stanford Writing 
Assessment. It \* now in the process of developing its own writing 
assessment instrument with the assistance of Dr. Eva Baker and the 
University of Hawaii. The pilot assessment, which is currently under 
way, involves 2,500 students in grades 3, 6, 8, and 10. The purpose of 
the assessment will be to inform instruction and improve curriculum. 

IDAHO 

Sally Tiel 208-334-2113 
Idaho Education Department 
650 West State Street 
Len B. Jordan Building 
Boise, ID 83720 

Idaho is field testing a fourth-grade writing performance assessment but has 
no plans to develop a portfolio assessment framework at this time. 
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ILLINOIS 

Carmen Chapman 217-782-4823 
Illinois Education Department 
100 North First Street 
Springfield ,IL 62777 

Illinois encouraged optional use of portfolio assessment at the local 
level as a part of its school accreditation process. This is a feature of 
complex generated responses framework developed in 1992. Schools are 
required to use a variety of assessments as a part of their local school 
improvement plan. 

INDIANA 

Beth Berghoff 317-232-9155 

Indiana Department of Education 

Center for School Improvement and Performance 

Room 229, State House 

Indianapolis, IN 46204-2798 

Indiana is using portfolios as part of a larger performance-based 
assessment system. Standardized assessment of writing is accomplished 
through prompted writing scored by rubrics on the state assessments at 
five grade levels. Portfolios are included as a recommended classroom 
assessment strategy. Teachers are learning to use students' work as a 
data source for profiling learning across time and to support students 
in becoming more articulate about their own learning. 

IOWA 

L. Johnson 515-281-3145 
Iowa Education Department 
Grimes State Office Building 
Des Moines, IA 50319-0146 

There is no statewide writing assessment in Iowa. Nonetheless, 
60-70 percent of all school districts conduct a voluntary writing 
assessment on their own. Outside consultants and State Department 
of Education personnel are utilized when requested. Since 1978, 
5,000 - 6,000 teachers have participated in the Iowa Writing Project, 
and more than 5800 students participated in the New Standards Writing, 
Reading and Mathematics Task Performance Assessments this past year. 
In the 1994-95 school year, 128 teachers will participate in the Portfolio 
Field Trial Assessment. 
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KANSAS 

MelRiggs 913-296-3379 
Kansas Education Department 
120 East Tenth Street 
Topeka, KS 66612 

The Kansas writing assessment consists of a single writing sample gathered 
from grades 5, 8, and 10 comprising 30,000 students per grade level. The 
state provides the prompt, although the local school may use their own. 
Students may also provide a writing sample from their portfolios, providing 
it meets four criteria: it was written in school; there was no extraordinary 
teacher intervention; there was an opportunity to revise; and the piece is 
not fiction, dramatic script or poetry. 

The writing sample is scored first on the local level according to a 
six-trait analytical model. A second reading is done by teachers over the 
summer at the Center for Educational Testing at the University of Kansas. 
The state and school districts use the writing assessment to gather 
information about instruction. 

KENTUCKY 

Starr Lewis 502-564-2106 
Kentucky Education Department 
Capitol Plaza Tower 
Frankfort, KY 40601 

Kentucky has in place for grades 4, 8, and 12, a writing portfolio assessment 
that involves the holistic evaluation of students 7 work by teachers. The six 
entries, chosen by the students from completed writings in all subject areas, 
include different types of writing composed for various purposes and 
audiences. At each grade level, content requirements include a personal 
narrative, a piece of fiction, and pieces that address a variety of purposes 
such as defending a position, explaining a process, and analyzing or 
evaluating a situation. In the assessment students are recognized as the sole 
creators, authors, and owners of their work. Teachers serve as coaches and 
mentors. Parents, friends, and other students assume roles of listeners, 
responders, and encouragers. 
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LOUISIANA 

Scott M. Norton 504 342-9935 
Louisiana Education Department 
P.O. Box 94064 
Baton Rouge, LA 70804-9064 

In Louisiana, the Graduation Exit Examination measures grade-appropriate 
proficiencies in English, language arts, mathematics, written composition, 
science, and social studies. The written composition test measures the 
students' competence to synthesize other language skills measured on the 
Graduation Exit Examination. It also measures student ability in organizing 
ideas and in responding appropriately to purpose and audience through 
the designated mode of writing. The State of Louisiana gives careful 
instructional attention to the writing process. The instructional program 
addresses four stages of writing: prewriting, draft writing, revising, and 
final writing. The written composition test supports this instructional model 
by duplicating the same process in its direct writing assessment. 

MAINE 

Horace Maxcy 207-287-5996 
Maine Education Department 
State House Station 23 
Augusta, ME 04333 

Maine has completed a pilot portfolio assessment program in grades 4, 8, 
and 11. A report on this project is available to other states. The results of this 
assessment are reported as proficiency levels rather than scale scores. 

MARYLAND 

Steve Ferrara 410-333-2369 
Gail Goldberg 410-333-2369 
Maryland Education Department 
200 West Baltimore Street 
Baltimore, MD 21201 

Maryland completed a pilot of an interdisciplinary portfolio for high school 
level and is considering implementing a high school assessment framework K 
that would integrate content-area knowledge and skills and cross content- 
area skills (eg. problem solving) into portfolios. Maryland assesses writing 
across content areas in grades 3, 5, and 8 and requires students to pass a 
two-essay (narrative and explanatory domains) minimum competency test 
to receive a high school diploma. 
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MASSACHUSETTS 

Teresa Fitzgibbon 616-388-3200 
Massachusetts Education Department 
^30 Main Street 
Maiden, MA 02148 

Writing is currently assessed by the Massachusetts Educational Assessment 
Program. All students in grades 4, 8, and 10 are asked to complete one open- 
ended question in math, reading, science and social studies. Approximately 
one-third of the questions are scored for quality of communication (writing) 
in addition to content knowledge. 

The recently enacted Education Reform Act will result in n new testing 
program. No decision has been made as to the form writing assessment will 
take. The use of portfolios is being considered. 

MICHIGAN 

Ellen Brinkley 616-387-2581 
Michigan Education Department 
P.O. Box 30008 
Lansing, MI 48909 

Michigan is in the process of creating a statewide writing assessment. 
The pilot is scheduled for November IW with full operation planned 
for the fall of 1995. All students in grades 5, 8, and 1 1 will be tested which 
encompasses over 100,000 students at each grade level. Development of the 
eleventh-grade test was by the Michigan Council of Teachers of English. 
A.C.T. is the test development contractor. 

The fifth- and eighth-grade assessments occur over a three-day period 
with 45 minutes allotted for writing each day. One extended piece of 
writing is developed. On the first day, there is a writing prompt, small 
group discussion and writing. Eighth graders will receive brief items to 
view or read as part of their writing stimulus. Day two consists of writing 
and further discussion, with revision, editing, and final draft occurring on 
day three. The assessments will be scored by Michigan teachers. 

The eleventh graders must pass a writing (three-strand) assessment to 
earn a state endorsement on their high school diploma. Strand one is called 
"Portfolio Pieces" and consists of two pieces of student selected writing, 
one of which must have been developed in a class other than English. These 
pieces are counted, but not scored. The second strand is called "Reporting 
and Reflecting." Students are given a specific prompt and 35 minutes to 
write about the pieces they have brought with them. Strand three occurs 
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over two days. On the first day, the students will bo given brief items to 
view or read, a prompt and then 20 minutes for a "quick write/' followed by 
a 10-minute group discussion. On the second day, the student will be given 
a prompt and 115 minutes to develop an extended piece of writing linked 
thematically to day one using pre-writing, drafting, revising, and editing. 
Three pieces of writing will be scored, the first two as first-draft writing, 
the final extended piece as polished, edited writing. 

MINNESOTA 

John Comstock 612-296-5078 
Minnesota Education Department 
550 Cedar Street 
Capitol Square Building 
St. Paul, MN 55101 

Grades 6, 9, and 11 participate in an assessment that reflects the writing 
process. The assessment occurs over a three-day period. On day one, a short 
writing survey is administered, followed by the presentation of the topic, a 
single prompt, and pre-writing. On day two, a first draft is prepared which 
is edited, re-written, and finalized on day three. 

The assessment was developed within the state by language arts 
professionals, K-12 staff, and the State Department of Education. Scoring is 
on a 6-point scale and is done by teachers who are hired and trained by the 
state. The assessment is used on the district level for local program and 
curriculum evaluation. 

MISSISSIPPI 

Cynthia Ward 60 1 -359-3052 
Mississippi Education Department 
P.O. Box 771 
Jackson, MS 39205 

In grade 11, Mississippi administers the Functional Literacy Examination 
which has a direct writing assessment component. Since passage is 
required for graduation, the examination is given in the spring with 
two opportunities to retake. 

Beginning in 1994, a new norm-referenced integrated language arts 
and mathematics assessment will be given in grades 4 - 9. This assessment 
combines performance items with multiple choice questions, t liven in 
October, it will serve a diagnostic function, and it will be a part of state 
accreditation. 
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MISSOURI 

James Friedebach 314-751-3545 
Missouri Elementary and Secondary 
Education Department 
P.O. Box 480, 205 Jefferson Street 
Jefferson City, MO 65102-0480 

Missouri is conducting a writing sample in grades 4, 8, and 11 on a yearly 
basis. Approximately 10 percent of the students in those grades are sampled., 
and the assessments are scored regionally across the state. Assessment takes 
three days for the student to complete. Missouri is experimenting with 
portfolio assessments at this time and plans to make use of them in some 
fashion within the next few years. 

MONTANA 

JanHahn 406-444-3714 
Montana Public Instruction 
PO. Box 202501 
State Capitol Room 106 
Helena, MT 59620-2501 

There is no statewide writing assessment in Montana. However, a number 
of local districts have developed their own writing assessment programs. 
State accreditation standards require districts to assess appropriately their 
locally developed learner goals. The program standard for communication 
arts states that instructional programs must teach process and focus on the 
communication of ideas. Many districts, therefore, utilize a single prompt or 
portfolio writing assessment to meet these standards. 

NEBRASKA 

Rex Filmer 402-471-4336 
Nebraska Education Department 
P.O. Box 94987 
Lincoln, NE 68509 

Nebraska does not conduct a statewide writing assessment. Local school 
districts primarily utilize standardized testing and teacher evaluation to 
assess writing proficiency. There is some interest in portfolio assessment 
on the local level and Educational Service Units are currently conducting 
in-service programs in this area. 




NEVADA 

Juliana Gabica 702-687-3913 
Nevada Education Department 
400 West King Street 
Carson City, NV 89710 

Nevada conducts a direct writing assessment in grades H atul 1 1 I In* 
eighth-grade assessment is scored on a 5-point analytical (rail s< ale. I he 
analytical traits are: ideas/content, organization, voire, ami i onventions 
Students write on one topic in two writing sessions on two mnsei utive ilciys 
in an attempt to duplicate the writing process. Passage ol llu* eleventh grade 
assessment is required for graduation. Students write on two lopli s whii \\ 
ore holistically scored on a 6-point scale by two scorers. Nevada has 
employed direct writing assessment since |*)7H ami uses a pool ol 
readers throughout the state, primarily English teaehers 

NEW HAMPSHIRE 

William B. Ewert 603-271-2298 
New Hampshire Education Department 
101 Pleasant Street 
Concord, NH 03301 

New Hampshire is developing its own assessment program. In 
May 1994, all third graders (16,000 students) were assessed in an 
on-demand writing task. By May 1996, students in grades 3, 6, and 10 
will respond to on-demand writing tasks. Consideration is being given to 
having the 1995 pilot for grades 6 and 10 include an open-ended editing task 
to get a better handle on mechanics and process writing. Test development 
has been done by Advanced Systems in Measurement and Evaluation, 
Dover, New Hampshire. Test results, reported by students on core items 
and by district, are intended to encourage and improve curriculum 
development. Although portfolio assessment is not employed on 
the state level, local school districts are encouraged to build on the 
statewide assessment. 

NEW JERSEY 

Elaine Young 609-777-3671 
New Jersey Education Department 
225 West State Street — CN 500 
Trenton, NJ 08675-0500 

New Jersey arintinisters two assessments in writing to all students in grades 
8 and 11. Passage of the grade 11 test is a requirement for high school 
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graduation. The grade 8 test serves as an early warning. Both tests are 
part multiple-choice (editing other fictitious students' work) and part essay. 
The grade 8 test contains a 40-minute essay while the grade 11 essay is 
60 minutes in length. New Jersey has also initiated the development of 
performance assessments for use by local districts to assess student 
proficiency in core courses. We are seeking information about 
portfolio assessment. 

NEW MEXICO 

Patricia Rael 505-827-6524 
New Mexico Education Department 
300 Don Gaspar — Education Building 
Santa Fe, NM 87501-6219 

Beginning in 1991-92, the department designed and utilized the Portfolio 
Writing Assessment Program. Early in the school year, teachers are provided 
with common prompts and a guide that assists students in understanding 
the criteria for good writing. The teacher provides lessons for the class and 
the student writes about the assigned topic until both the teacher and 
student are satisfied that the students' piece of writing demonstrates his 
or her best efforts. This is repeated with each prompt. Pre-writing activities 
and drafts are stored in the students' portfolios for review and reflection. In 
the spring, the prompt selected for scoring is announced by the department. 
The teacher and student then work together to select the best piece of 
writing for transcribing onto a booklet. The student's writing is then 
scored against a set of criteria. 

NEW YORK 

Carolyn Byrne 518-474-5902 

New York Elementary, Middle and Secondary 

Education Office 

Education Building, Annex, Rm. 875 
Hawk and Elk Streets 
Albany, NY 12234 

In New York State, there are three writing assessments: the grade 5 
Pupil Evaluation Program (PEP) writing test, the grade 8/9 preliminary 
competency test (PCT) and the grade 11/12 Regents competency test 
(RCT). The tests are developed by the State Education Department with the 
assistance of classroom teachers. Each assessment is a direct measure of a 
student's ability to communicate in writing. Tasks are geared to grade level 
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and student responses are relatively brief, ranging from 100-200 words. 
Students are given the opportunity to follow the process writing approach. 

The method of rating student responses for the writing tests is 
holistic. The PEP writing test employs two raters for each of two student 
responses, whereas the PCT and RCT employ a different rater for each of 
three writing responses, averaging the three ratings to achieve a final score. 
RCT papers receiving a final score of 60 and above are forwarded to the 
state for analysis, with a summary of test results returned to school 
administrators. The PEP and PCT provide early identification of students 
who need special help in developing the basic skills in writing. Students 
must pass the RCT in writing or the Regents comprehensive examination 
in English in order to receive a local high school diploma. 

In addition to the writing assessments that are part of the Regents 
Competency Testing Program, the New York State's Regents Examination 
Program assesses writing in its Regents comprehensive examination in 
English. As part of this assessment, students are required to write an essay 
of approximately 250 words based on one of two assigned literature essay 
items. Topics in the essay item may be related to plot, setting, characters, 
theme and /or literar\ devices. Students are also required to write a 
composition of approximately 250 words. Students select one of two 
"situations" that present a purpose for the piece of writing and the specific 
audience or they choose one of six assigned topics. The topics allow 
students to determine their own purpose and audience for their writing. 
They cover areas such as science, the arts, sports, and current issues. 

The method of rating student responses to both the literature essay 
and the composition for the Regents comprehensive examination in English 
is holistic. Specific criteria for rating the literature essay and composition 
responses are provided. Use of the committee method for rating tftese 
responses is strongly recommended as a way of improving the reliability 
of the ratings. The two writing tasks in the Regents comprehensive 
examination in English represent 55 percent of the total examination score 

NORTH CAROLINA 

Daisy Vickers 919-715-lUOO or 1190 
North Carolina Public Instruction 
Department 

301 North Wilmington Street 
Raleigh, NC 27601-2825 

North Carolina has been conducting statewide writing assessment and 
training workshops since 1983. State statutes in 1992 charged the schools to 
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promote curriculum referenced, state-developed tests, and performance 
measures to replace nationally normed tests. Assessment of writing 
occurs for every student in grades 4, 6, and 8 each year and all students 
in grades 3-8 also take ten open-ended items in reading, mathematics 
and social studies at the end of the year. English II students are asked to 
write two compositions each year. All writing is scored centrally using 
a holistic approach. 

NORTH DAKOTA 

Clarence A. Bina 701-224-2098 

North Dakota Public Instruction 

Department 

600 East Boulevard 

Bismarck, ND 58505-0440 

North Dakota is revising its English language arts framework. This will lead 
to some type of writing assessment in the future. 

OHIO 

Keith Gochnour 614-466-0223 
Ohio Education Department 
65 South Front Street 
Columbus, OH 43215-4183 

Writing assessment is conducted as part of the proficiency testing program 
at grades 9 and 12. In school year 1994-95, grade 4 will be added and grade 6 
will begin the following year. 

The writing assessment at grades 9 and 12 consists of two prompts and 
is holistically scored on four- and six-point rubrics respectively. The fourth- 
and sixth-grade assessments are still in development. 

For ninth-grade students, the assessment in writing and other subject 
areas constitutes an exit exam and must be passed in order to graduate. 
The twelfth-grade assessment enables local school districts to evaluate their 
programs. The fourth- and sixth-grade assessments are seen as a means to 
identify students needing intervention. 




OREGON 

Michael Dalton 503-378-8004 
Oregon Education Department 
255 Capitol Street, NE 
Salem, OR 97310-0103 

Oregon conducts a statewide writing assessment of all students in 
grades 3, 5, 8, and 11 each year. This involves 30,000 - 40,000 students at 
each grade level. Students are given three 45-minute class periods to write. 
They are randomly assigned modes of writing (descriptive, narrative, 
expositor}^, imaginative, or persuasive) and two choices of topic. Students 
are encouraged to use a process writing approach and any tools (thesaurus, 
dictionary, etc.) to assist them. The final essay is scored on six traits: ideas 
and content, organization, voice or style, word choice, sentence fluency, 
and conventions (grammar and punctuation). Each element is rated on a 
1-5 scale by two independent scorers with an additional holistic score given 
on the mode of writing. A third reading is used if there is a significant 
discrepancy in score. 

Oregon classroom teachers are trained to score the test, which is 
given in February, scored in March and returned to students in April. This 
schedule is employed since feedback to the student is of prime importance. 
The writing assessment was developed more than a decade ago in a local 
school district with the assistance of the State Department of Education. 
Several states have made use of the Oregon model. 

PENNSYLVANIA 

Susan Spadafore 

Pennsylvania Elementary and Secondary 
Education Office 
333 Market Street 
Harrisburg, PA 1712MJ333 

The Pennsylvania Writing Assessment is given to a representative sample 
of students in grades 6 and L ) annually. Holistic scores provide the basis 
for school, district and statewide data on the status of student waiting. Since 
the statewide assessment is not intended to make decisions about individual 
students, districts are encouraged to develop writing portfolios that would 
include a series of writing samples over time. 

State regulations require districts to develop a portfolio assessment 
system that would provide documentation of achievement of the 53 state- 
identified student learning outcomes, a part of which may be writing 
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samples. An audit of these portfolios could become part of the state 
assessment plan when all districts have portfolios in place. 

RHODE ISLAND 

Susan Lima 401-277-6887 
Rhode Island Education Department 
Elementary and Secondary Office 
22 Hayes Street 
Providence, RI 02908 

Rhode Island is developing a portfolio system for grades 1 through ft that 
focuses on the integration of instruction and assessment in language arts 
and math. In the third year of its program, 125 teachers continue to be 
involved. These teachers return to their districts and teach others in the 
development and use of portfolio assessments. 

SOUTH CAROLINA 

Diana J. Ashworth 803-734-8492 
South Carolina Education Department 
1429 Senate Street 
Columbia, SC 29201 

South Carolina's Basic Skills Assessment Program includes writing tests in 
Grades 6 and 8 and at the exit examination level. The students are giv en 
prompts on which to write their untimed compositions. The students are 
provided paper to develop first drafts of their compositions. The final draft 
are written in their answer folders and are scored independently by two 
readers using a 4-point modified holistic score scale. Third readers score 
papers when the first two readers do not agree. All papers that do not meet 
the minimum standard of 3 on the 4-point scale are scored analytically to 
provide information to schools for remedial purposes. 

SOUTH DAKOTA 

Rick Helhaus 605-773-3134 
South Dakota Education Division 
700 Governors Drive 
Pierre, SD 57501-2291 



South Dakota has no plans to develop a portfolio assessment framework at 
this time. 



TENNESSEE 

Dr. Fretta M. Bunch 615-974-5385 
State Testing and Evaluation Center 
25 HPER Building 
Knoxville, Tennessee 37996-1530 

October 1994 will mark the first state-funded administration of the TCAP 
Writing Assessment. Students in grades 4, 8, and 11 will be assessed each 
October. The target modes will be descriptive for grade 4, expository for 
grade 8, and persuasive for grade 11. A six-point focused holistic scale will 
be used. The Tennessee Department of Education will contract for scoring. 
Results of the assessment will be for diagnostic purposes. The criteria for 
scoring grade 11 essays is the same as the Tennessee Board of Regents uses 
for placement into remedial, developmental, or college-level courses. 

TEXAS 

Patricia S. Porter 512-463-9734 
Texas Education Agency 
1701 North Congress Avenue 
Austin, TX 78713-7508 

Texas is in its fifteenth year of statewide performance assessment of 
writing. Students at grades 4, 8, and exit level receive a holistic score 
of a composition written on a prescribed topic and for a prescribed 
purpose. Each student performing below minimum expectations is given 
an analytic summary of his or her performance indicating possible 
remediation strategies. Presently there is no timetable to employ 
statewide portfolio assessment. 

UTAH 

Mary Beth Clark 801-538-7500 
Utah Board of Education 
250 East 500 South 
Salt Lake City,UT 84111 

Utah initiated the development of performance assessment exercises 
in 1992. 
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VERMONT 

Geof Hewitt 802-828-3111 
Vermont Education Department 
State Office Building 
Montpelier, VT 05602-2703 

Vermont has portfolio pilot project reports, including samples of student 
work, available to other states. Portfolio assessment took place in grades 
4 and 8. Portfolio materials were selected by students. Refinement of scoring 
procedures and training of scorers at the state level continues to take place. 

VIRGINIA 

Doris Redfield 804-225-2102 
Virginia Education Department 
101 North 14th Street 
P.O. Box 2120 
Richmond, VA 23216-2120 

Virginia administers a legislatively-mandated Literacy Passport Test in 
reading, writing, and mathematics in grade 6. Students who do not pass 
all three components of the LPT as well as students who transfer into the 
Virginia public schools take the test in grades 7-11. This test must be passed 
in order to be fully classified as a high school student. Passing the Literacy 
Passport Test is also a requirement for a standard high school diploma 
beginning with the class of 1996. 

The writing assessment component of this test is a prompted, 
on-demand writing task. The first-draft essay is evaluated in five domains: 
composing, style, sentence formation, usage, and mechanics. A 4-point scale 
is used in each domain. The assessment was developed by the Virginia 
Department of Education in conjunction with an outside contractor. The 
tasks arc also scored by an outside contractor. A fourth-grade assessment is 
given on a voluntary basis by local districts to help identify those students 
who are at risk and may need early intervention to pass the Literacy 
Passport Test. 




WASHINGTON 

Gordon Ensign 206-753-3449 
Washington Public Instruction Department 
P.O. Box 47200 
Olympia, WA 98504-7200 

At present, writing assessment is not done on a regular basis in Washington, 
only a periodic sampling of student work is evaluated. This is due to change 
within the next two years. 

The Commission on Student Learning is currently developing a 
statement of essential required learning for students. This will determine 
standards for curriculum and a specific framework for assessment. Eight or 
nine areas of learning are to be covered, including writing. Implementation 
of writing and three other areas is scheduled for the 1996-97 school year. 

WEST VIRGINIA 

Karen Nicholson 304-558-2651 
West Virginia Education Department 
Capitol Complex, B358, Bldg. 6 
Charleston, WV 23505-0330 

West Virginia currently has in place a Writing Assessment Program in 
grades 8 and 10. In 1994-95, a writing component will be added to a 
performance assessment already in place in grades 1 through 7. This 
performance test, WV-STEP (West Virginia Statewide Testing of Educational 
Progress), tests all students in grades 1 through 8 in the ares of mathematics 
and language arts. There are no plans to develop a portfolio assessment 
framework at this time. 

WISCONSIN 

Darwin Kaufman 608-267-9111 
Wisconsin Department of Public Instruction 
P.O. Box 7841 
Madison, WI 53707-7841 

Wisconsin currently tests students at grades 8 and 10 with a two-prompt 
writing assessment. Students have thirty minutes for each of the two 
prompts, one of which is expressive and the other persuasive. The test is 
administered and scored by Psychological Corporation. They are currently 
developing an on-demand performance assessment in language arts, 
mathematics, and science. The contractor is Wisconsin Center for Education 
Research at the University of Wisconsin. The center uses Wisconsin teachers 
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as writers, field testers, and scorers. Although writing is a feature of each of 
these assessments, in language arts it plays a major role. The language arts 
instruments represent week-long "curricular events" in which the student 
reads, views, speaks, listens, and writes. The entire instrument is scored for 
student's ability to make meaning by using language. A second score is 
given on the center piece, a written product evaluated for substance, 
development, coherence, conventions, and style. The performance 
assessments are one of three indicators in the Wisconsin Student Assessment 
System scheduled to be in place in 1996-97. The other components are a 
criterion-referenced, limited-response knowledge and concepts test and a 
locally controlled portfolio. 

WYOMING 

Nancy Leinius 307-777-6226 

Wyoming Education Department 

2300 Capitol Avenue, 2nd Floor Hathaway Building 

Cheyenne, WY 82002-0050 

There is no statewide writing assessment in Wyoming. Local districts are 
encouraged to develop writing assessment programs to meet local needs. 
Many that have are using the Direct Writing Assessment six-trait model. 
The state legislature has mandated district accountability, but has not 
funded it. It is unlikely that districts will support any program that 
encourages comparing district performances. 



Appendix B 



Annotated Bibliography 



Background on Writing Assessment 

Gifford, Bernard, ed. Changing Assessments: Alternative Views of Aptitude, 
Achievement, and Instruction. Boston: Kluwer Academic Publishers, 1992. 
See Chapters 3 ("Assessment in Context: the Alternative to 
Standardized Testing" by Howard Gardner) and 4 ("Interactive 
Learning Environments: A New Look at Assessment and 
Instruction" by Ann J. Brown et al). 

Grant, Gerald et al, eds. On Competence. San Francisco: Jossey-Bass, 1979. 
Elbow (CCC article) cites "Contributing to Learning by Assessing 
Student Performance" (Grant and Wendy Kohl). 

Lucas, C. K. "Toward Ecological Evaluation." The Quarterly of the National 
Writing Project and the Center for the Study of Writing (1988). 
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Purves, Alan. The Scribal Society. New York: Longman, 1990. 

In Chapter 8, pp. 108-113, "The Gatekeepers of Scribal Society," 
domain-referenced assessment model for writing proposed. 

Resnick, Daniel P. and Resnick, Lauren B. "Standards of Curriculum and 
Performance: A Historical and Comparative Perspective." Educational 
Researcher, April 1985: 5-21. 

Romano, Tom. "A Time for Immersion, A Time for Reflection: The 
Multigenre Research Project and Portfolio Assessment." Paper presented at 
the Annual Spring Meeting of the National Council of Teachers of English, 
March 1991. 

Stiggins, Richard J. "Assessing Literacy." Phi Delta Kappan, V 72, 
March 1991:534-540. 

Need for parent, teacher, and administrator understanding of 
assessment issues. 

Wiggins, Grant. "Toward More Authentic and Equitable Assessment." 
Phi Delta Kappan (May 1989): 703-713. 

Williamson, Michael M. and Huot, Brian A., eds. Validating Holistic Scoring 
for Writing Assessment: Theoretical and Empirical Foundations. Cresskill, 
New Jersey: Hampton Press, 1993. 

Suggests that a truly holistic scoring model would make use 
of portfolios. 

Background on Writing Process 
Approaches in the Classroom 

Appleby, Arthur. Contexts for Learning to Write (Studies oj Sfi ondaiv Si hool 
Instruction). Norwood, New Jersey: Ablox, 1984. 

Rich in concrete data from NIE national study; case sttul v 
approach to uses of writing in high schools; focuses on individual 
uses (p. 4), failure of process instruction (p. 187); coding ol poitlolio 
samples (p. 191). 

Bennett & Desforges, eds. British Journal of Educational Psychology. 

Good overview of research into composing process in England and 
the United States by Wilkinson. Excellent international bibliography. 
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Judy, Steven and Judy, Susan. An Introduction to tlw Teaching of Writing. 
New York: Wiley, 1981: 162. 

Reference in Krest's English Journal article as first introduction 
to portfolios. 

Wilkinson, Andrew. "Writing." Chapter 2 of British journal of Educational 
Psychology (Bennett and Desforges, eds.). 

Good overview of UK and US research in secondary writing 
instruction since 1960s. 



Portfolios (General Definitions, Procedures, Issues) 

Paulson, F. Leon et al. "What Makes a Portfolio a Portfolio?" Educational 
Leadership. February, 1991. 

Provides definition developed by Northwest Evaluation 
Association and eight guidelines for 'fulfilling the potential of 
portfolios.' See also Paulson, F. Leon and Paulson, Pearl R. "The 
Making of a Portfolio" (1991 pre-publication draft) for more detailed 
set of pr ~edures. 

Paulson, F. Leon and Paulson, Pearl R. "How Do Portfolios Measure Up? 
A Cognitive Method for Assessing Portfolios (Revised)." Paper presented 
at the Annual Meeting of the Northwest Evaluation Association, Union, 
Washington, August 2-4, 1990. 

Perone, Vito. Expanding Student Assessment. Alexandria, Virginia: 
Association for Supervision and Curriculum Development, 1991. 

Collection of essays proposing assessment reform, including 
accounts of portfolio use. 

Ruth, Leo and Murphy, Sandra. Designing Tasks for the Assessment of Writing. 
Norwood, New Jersey: Ablex Publishing Corporation, 1988. 

Lee Odell's (1981) portfolio system design (pp. 103-104) is described 
briefly in Chapter 6 ("Knowledge from Theories and Models"), 
and the Minneapolis Benchmark Writing Tests are described very 
briefly (p. 242) in Chapter 12 ("Guidelines for Designing Topics 
for Writing Assessment"). The Assessment of Performance Unit 
(1975) in the United Kingdom is discussed in these two chapters 
(pp. 113-114, 242, 250-252, 286), as are Ontario, Canada writing 
assessment projects (pp. 114-115, 242). 
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The Writing Assessment Handbook: Grade 8. Bureau of Publication Sales, State 
Department of Education, P.O. Box 271, Sacramento, California. 

Types of samples and scoring guides taught to students for peer 
assessment of multiple samples ($10). 

Valencia, Sheila. "Assessing Literacy in the Middle School." Reading in the 
Middle School (2nd edition), G. Duffy, ed. 

Addresses theoretical concerns in setting up a portfolio 
assessment system. 

Portfolios & Classroom Instruction 

— "Portfolios: Useful Assessment Tool." Education USA, N 32 (November 27, 
1989): 97-98. 

Summary of 1989 NCTE Convention presentations on classroom use 
of portfolios. 

Belanoff, Pat and Dickson, Marcia, eds. Portfolios, Process and Product. 
Portsmouth, New Hampshire: Boynton Cook, Inc., 1991. 

See Chapters 17 ("Portfolios Evolving: Background and Variations 
in Sixth-through Twelfth-Grade Classrooms" by Roberta Camp and 
Denise Stavis Devine), 18 ("Portfolios for Student Empowerment 
and Teacher Change" by Kerry Weinbaum). 

Krest, Marjorie. "Adapting the Portfolio to Meet Student Needs." The 
E)iglish journal, February: 29. 

Adapting portfolios to different grade, motivational, and ability 
levels of students; portfolios as documentation of learning process; 
adapting assessment/grading to portfolios; introducing variety of 
modes into writing instruction. 

Sobol, Thomas. A New Compact for Learning: Improving Public Elementary, 
Middle, and Secondary Education in the 1990s. Albany, New York: State 
Education Department of New York, 1991. 

Portfolios & Classroom Assessment 

— The Whole Language Evaluation Book. Portsmouth, New Hampshire: 
Heinemann, 19W. 
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Anthology of essays by teachers and consultants on issues of 
classroom evaluation in whole language programs. 

Andrade, Joanne. "A Quality Approach to Writing Assessment." Educational 
Leadership. Educational Leadership, 50.3 (November 1992): 22-23. 

Arter, Judith. Using Portfolios in Instruction and Assessment. Portland, Oregon: 
Northwest Regional Educational Laboratory Test Center, 1990. 

Ballard, Leslie. "Portfolios and Self-Assessment." The English journal, 

February 1992: 46-48. 

Folder approach to instruction (all work in year); portfolios as basis 
for final examination in advanced senior high school composition 
class; students rank all papers in folder, assess own progress and 
talk about changes in attitudes about writing. 

Bradley-Johnson, Sharon. Problems in Written Expression: Assessment and 

Remediation. New York: Guilford Press, 1989. 

"Portfolio Evaluation" (pp. 125-137) by Christopher Burnham covers 
college freshman class procedures for implementation and 
evaluation of portfolios; much of it is applicable to senior high 
school classrooms. 

See also chapter ("Discourse Organization/' p. 109) in Section II 
(Language Teaching) on discourse organization for methods of text 
analysis related to making meaning. 

Bunce-Crim, Mama. "Writing Evaluation: Tracking Daily Progress." 
Instructor, V 101, March 1992: 24-25. 

Contains tips for checklists, conferences, and writing behaviors to 

look for in elementary classroom. 

Burnham, C. "Portfolio Evaluation: Room to Breathe and Grow." Training the 

Teacher (Bridges, C, ed). Urbana, Illinois: NCTE, 1986. 

Describes the use of portfolios for assessment in college classrooms, 
however, the procedures can be relevant to high school instruction, 
as well. 

Cambourne, Brian and Turnbill, Jan. "Assessment in Whole Language 
Classrooms: Theory into Practice." The Elementary School Journal, N 90 
(1990): 337-349. 

Discusses assessment as a vital part of whole language 

classroom approach. 
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Cooper, Winfield and Brown, B. J. "Using Portfolios to Empower Student 
Writers/' English Journal, February 1992: 40-45. 

Power of portfolios as teaching tools; integration of statewide 
assessments into classroom implementation of portfolios; samples 
of writing to learn (Britton). 

Curran, P "The Portfolio Approach to Assessing Student Writing: An 
Interim Report." Composition Chronicle, March 1989: 6-7. 

DeFina, Allan A. "Alternative Integrated Reading/Writing Assessment and 
Curriculum Design." Journal of Reading, 34.5 (February 1991): 354-59. 

Gearhart, Maryl. Writing Portfolios at the Elementary Level: A Study of Methods 
for Writing Assessment. University of California Center for the Study of 
Evaluation, 1992. 

Provides an overview, including a useful definition of portfolios, 
and reports empirical data on utility and meaningfulness of using 
holistic scoring on portfolios, as well as qualitative studies of scoring 
approaches drawing on raters' critiques of the analytical approach 
to scoring. 

Gitomer, D. H. "Developing A Portfolio Culture that Enables Learners." 
Paper presented at 1989 National Summit Conference on the Arts and 
Education, Nov. 11, 1989. 

Graves, Donald H. and Sunstein, Bonnie S., eds. Portfolio Portraits. 
Portsmouth, New Hampshire: Heineman, 1992. 

Section I ("Classroom Practice") contains accounts of portfolio 
use in first-, fifth-, and eighth-grade classrooms; Section II contains 
"Helping Children to Read Their Portfolios" by Graves, as well as 
chapters on large-scale portfolio assessment and definitions of the 
term "portfolio"; the book concludes with case studies of one 
superintendent and two students, one bilingual. 

Murphy, Sandra and Smith, Mary Ann. Writing Portfolios: A Bridge from 
Teaching to Assessment. Markham, Ontario: Pippin Publishing Limited, 1991. 

Paratore, Jeanne R. "Portfolio Assessment in the Reading-Writing 
Classroom." The Reading Teacher, 35.5 (February 1992): 424-426. 

Stewart, Roger A. "Portfolio Assessment in the Reading- Writing 
Classroom." The Reading Teacher, 46.6 (March 1993): 512-513. 

Stewart, Roger A. "Writing portfolios: A Bridge from Teaching to 
Assessment." The Reading Teacher, 46.6 (March 1993): 523-524. 
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Tanner-Cazinha, Diane. "Portfolio Assessment in the Reading-Writing 
Classroom." Language Arts, 68.8 (December 1991): 669-673. 

Teale, William H. "Developmental^ Appropriate Assessment of Reading 
and Writing in the Early Childhood Classroom." The Elementary School 
Journal 89.2 (November 1988): 172-181. 

Tierney, Robert J. et al, eds. Portfolio Assessment in the Reading-Writing 

Classroom, Christopher-Gordon, 1991. 

Guide to implementing portfolio assessment in classroom to build a 
tradition of student-centered approaches to assessment. 

Valencia, Shiela W. "Portfolio Assessment in the Reading- Writing 
Classroom." The Reading Teacher, 45.3 (November 1991): 244-245. 

Wolf, Dennie P "Portfolio Assessment: Sampling Student Work/ 1 
Educational Leadership, 46.7 (April 1989): 35-9. 



Large-Scaie Portfolio Assessments 

— "Committee to Design Statewide Portfolio Writing Assessment and 
Student Portfolios/' Vermont Education 14:3 1987-8. 

Outline of plans for "An Approach for Schools Accountability 
for Vermont/' including timeline and costs for statewide 
portfolio assessment. 

— "Writing Evaluation: Picture of a Portfolio." Instructor, VI 01, 
March 1992: 28-30. 

Contains state assessment samples from a fourth-grade 
Vermont classroom. 

Belanoff, Pat et al. "Models of Portfolio Assessment." Notes from the National 
Testing Netivork in Writing, November 1985, 2, 7. 

Black, Laurel et al. New Directions in Portfolio Assessment . Portsmouth, 

New Hampshire: Boynton Cook, 1994. 

This text moves beyond the logistics of initiating portfolio 
assessment at local, state, and national levels to theoretical issues 
and the initiation of new research agendas. Questions of mass 
assessment, subversion of the democratic aspects of portfolios, their 
role in teacher training, gender and cultural issues are addressed by 
a variety of writing experts and classroom teachers. 
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Breeland, H. The Direct Assessment of Writing Skills: A Measurement Review. 
New York: College Entrance Examination Board, 1983. 

Camp, Roberta. "The ETS Writing Portfolio: A New Kind of Assessment" 
Conference paper, National Council on Measurement in Education. 

ETS portfolio project early '80s. See also "Portfolios as Proficiency 
Tests/' with Pat Belanoff in Notes from the National Testing 
Network in Writing (1987). 

Camp, Roberta. "Thinking Together About Portfolios." The Quarterly of the 
National Writing Project and the Center for the Study of Writing. 

Cohen, Michael. "Designing State Assessment Systems." Phi Delta Kappan, 
V69, April 1988: 583-589. 

Charges school administrations with responsibility for 
determining quality of assessment tools used; need for data 
on educational practices. 

Conry, R and Jeroski, S. British Columbia Assessment of Written Expression 
1978: General Report. Victoria, British Columbia, Canada: Queens Printer for 
British Columbia, 1980. 

Courts, Patrick. Assessment in Higher Education: Politics, Pedagogy, and 
Portfolios. Westport, Connecticut: Praeger, 1993. 

Introduction and Chapter 1 deal with elementary and secondary 
school issues of district and national assessment; compares goals of 
assessment with higher education; contains extensive bibliography. 

Degenhart, R. E. (ed.). Assessment of Student Writing in an International 
Context. Jyvaskln, Finland: University of Jyvaskla Press, 1987. 

Christie and Forest. Standard* at GCI1 A-level 196.1 mid 1973. London: 
MacMillan Education. 

Freedman, Sarah Warshauer. "Linking Large-Scale Testing and Classroom 
Portfolio Assessments ot Student Writing." Ilducational Assessment, Volume 
1,N 1, 1993: 27-52. 

Examines four projects: Arts PROPEL (Pittsburgh Public Schools), 
The Primary Language Record (England), Vermont Portfolio 
Assessment, and the General Certificate of Secondary Education. 

Gorman, T. P. et al, eds. The ILA Study of Written Composition. New York: 
Pergamon Press, 1988. 
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Howard, Katharyn. "Making the Portfolio Real." The Quarterly 
(Spring 1990). 

Eighth-grade teacher in Pittsburgh describes participation over 
two years in the Arts PROPEL writing team in collaboration with 
1 larvard's Graduate School of Education and ETS. 

Meyer, C. et al. "NWEA White Paper on Aggregating Portfolio Data." Paper 
presented at the Aggregating Portfolio Data Conference sponsored by the 
Northwest Evaluation Association, Union, Washington. 

Murphy, Sandra and Smith, Mary Ann. "Talking About Portfolios." The 
Quarterly of the National Writing Project and the Center for the Study of Writing, 
12:3 (1990): 1-3,24-27. 

National Examining Association, England. General Certificate of Secondary 
English syllabus b: Syllabus for the 1989 Examination. Bellman Yard, Newport, 
Shopshire, England: Advertiser Printing Works. 

Assessment system in England using oral communication and 
written work; contains directions to teachers for assigning work, 
selecting most representative pieces, and criteria for making 
assessm?nts of five samples. Assessment objectives and system 
review procedures included also. 

O'Brien, Charlotte. "A Large-Scale Assessment to Support the Process 
Paradigm." English Journal February 1992: 28-33. 

Describes administration and holistic scoring of essays 
generated in four stages over three days, including pre-vvriting 
and peer-evaluation before revision. 

The New Standard. New Standards Project, National Center on 
Education and the Economy, 700 Eleventh Street N.W., Suite 750, 
Washington, D.C. 20001. 

Grassroots project of states and urban school districts to develop 
national standards and assessment system, to gauge student 
progress towards standards; 20 states and six cities. 

Purves, Alan. An International Perspective on the Evaluation of Written 
Composition. Oxford, England: Pergamon Press, 1982. 

Purves, Alan and I lawisher, Gail. Writers, judges, and Text Models. Chapter 8 
in Volume 34 of Advances in Discourse Processes. Norwood, New Jersey: 
Ablex, 1990. 
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Provides an interpretation of the IEA study of written composition 
in 14 countries. 



Rothman, Robert. "Vermont Plans to Pioneer with 'Work Portfolios': 
Assessment to Include Best Pupil Materials." Education Week, 8:8 
(October 26, 1988). 

Announcement of first statewide portfolio assessment, with 
comments by Koretz (RAND Corporation), Sizer, Wiggins. 

Thomas, Bill et al. "California Learning Assessment System: Organic 
Portfolio Assessment Project." California Curriculum Nezvs Report, 19.3 
Oanuary 1994). Hayward, California: Alameda County Office of Education. 
Discusses pilot program for developing portfolio assessment 
out of an integration of state mandates and classroom 
instructional programs. 

Verhoeven, Ludo and de Jong, John H.A.L., eds. The Construct of Language 
Proficiency: Applications of Psychological Models to Language Assessment. 
Philadelphia: John Benjamins Publishing Company, 1992. 

In Chapter 7, Carel van Vijk describes a method of analyzing 
portfolios (information analysis); in Chapter 8, Henk Blok and Kees 
de Glopper contrast large-scale writing assessments in the United 
States and in Europe. 

Cross-References 

Camp, Roberta. "Changing the Model for the Direct Assessment of Writing." 
In M. Williamson and B. Huot. 

Cooper, Charles. The Nature and Measurement of Competency in English. 
Urbana, Illinois: National Council of Teachers of English, 1981. 

Gardner, Howard. "On Assessment in the Arts: A Conversation with 
1 toward Gardner." Educational Leadership, 45: 30-34. 

Greenburg, Karen et al. Writing Assessment: Issues and Strategies. New York: 
Longman, 1986. 
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Herter, Roberta J. "Writing Portfolios: Alternative to Testing." English 
journal 80.1:90. 

Cited in Cooper's article; self-assessment encouraged by portfolios. 

McClelland, David. "Testing for Competency Rather Than Intelligence." 
American Psychologist, January 1973: 1-14. 

Rief, Linda. "Finding the Value in Evaluation: Self-Assessment in a Middle 
School Classroom." Educational Leadership 47.6: 24-29. 

Cited in Cooper's article; criteria for sample selection in portfolios; 

student decisions on what to write and rewrite; self-evaluation 

equals coming to know selves as learners; case studies of 

her students. 

Cited in CCC article by Elbow; questions validity of of standardized 
tests and proposes testing through the use of criterion-sampling 
tests where criteria are grouped in clusters of life outcomes. 

Wiggins, Grant. "A Response to Cizek" (Cizek, Gregory. "Innovation or 
Enervation? Performance Assessment in Perspective.") Phi Delta Kappan 
(At Odds: Performance Assessment), V 72, May 1991: 695-699). 

Wiggins cites portfolio work of ETS and British APU, reliability of 
N AEP assessmentL>need for greater face validity of instruments in 
response to Cizek's (ACT) dismissal of performance assessment. 
Cites Resnick and McClellan (see above). 

Winner, Ellen and Gitomer, Drew H. Arts PROPEL: An Introductory 
Handbook. Princeton, New Jersey: ETS, 1991. 

Wolf, Dennie P. "Opening Up Assessment." Educational Leadership, 
January 1988. 

Describes ETS/ Harvard Project Zero project in junior /senior 
high school arts classrooms where portfolio system is central to 
learning process. 

Wolf, Richard M. "The NAEPand International Comparisons." Phi Delta 
Kappan, April 1988: 580-582. 

Discussed issues arising in collaboration of 1EA, with 40 member 

nations, and NAEP 
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Writing Assessment Leadership Committee. Vermont Writing Assessment: 
The Pilot Year. Montpelier, Vermont: State Department of Education, 1990. 



Periodicals 

Cooper, Winfield. and Davies J., eds. Portfolio News. Portfolio 
Assessment Clearing House, University of California, San Diego, Teacher 
Education program, 9500 Gilman Drive, La Jolla, California 92093-0070 
published quarterly. 

See also Portfolio News. Portfolio Assessment Clearing House, 
San Dieguito Union School District, 710 Encinitas Boulevard, 
Encinitas, California 92024. 

Descriptive articles of portfolio assessment programs; discussion of 
issues and questions involved in implementation of same. 

Portfolio Assessment Newsletter. Northwest Evaluation Association, 
5 Centerpointe Drive, Suite 100, Lake Oswego, Oregon 97035. 

Information network for educators interested in portfolios and 
portfolio assessment. 

The Quarterly of the National Writing Project and the Center for the Study 
of Writing. Berkeley, California: University of California Graduate School 
of Education. 



Other Elementary & Secondary Issues 

Sugarman, Jay. "Teacher Portfolios Inform Assessment," Harvard Education 
Letter, 5.3 (1989): 5-6. 

Portfolios in Higher Education 

Belanoff, Pat and Elbow, Peter. "Using Portfolios to Increase Collaboration 
and Community in a Writing Program." Writing Program Administration, V 9, 
N 3, Spring, 1986. 

Brad ley-Johnson, Sharon. Problems in Written Expression: Assessment and 
Remediation. New York: Guilford Press, 1989. 
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"Portfolio Evaluation" (pp. 125-137) by Christopher Burnham covers college 
freshman class procedures for implementation and evaluation of portfolios. 
See also chapter ("Discourse Organization," p. 109) in Section II 
(Language Teaching) on discourse organization for methods of text 
analysis related to making meaning. 

Breeland, H. The Direct Assessment of Writing Skills: A Measurement Review. 
New York: College Entrance Examination Board, 1983. 

Burnham, C. "Portfolio Evaluation: Room to Breathe and Grow." Training the 
Teacher (Bridges, C, ed). Urbana, Illinois: NCTE, 1986. 

Describing use of portfolios for assessment in college classrooms. 

Elbow, Peter and Belanoff, Pat. "Portfolios as a Substitute for Proficiency 
Examinations." College Composition and Communication, 37 (1986), 336-339. 

Grant, Gerald et al, eds. On Competence. San Francisco: Jossey-Bass, 1979. 

Purves, Alan. An International Perspective on the Evaluation of Written 
Composition. Oxford, England: Pergamon Press, 1982. 

Purves, Alan. The Scribal Society. New York: Longman, 1990. 

In Chapter 8, pp. 108-113, "The Gatekeepers of Scribal Society," 
domain-referenced assessment model for writing proposed. 

Purves, Alan and Hawisher, Gail. Writers, Judges, and Text Models. Chapter 8 
in Volume 34 of Advances in Discourse Processes. Norwood, New Jersey: 
Ablex, 1990. 

Resnick, Daniel P. and Resnick, Lauren B. "Standards of Curriculum and 
Performance: A Historical and Comparative Perspective." Educational 
Researcher, April 1985: 5-21. 
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Appendix C 



Procedural Appendix 

Introduction 

This appendix provides further information about the methods and 
procedures used in NAEP's 1992 writing portfolio study, The NAEP 1992 
Technical Report provides more extensive information about procedures. 

NAEP's Writing Assessment Framework 

Developed by a committee of writing researchers, teachers, curriculum 
specialists, and business representatives, under the direction of the National 
Assessment Governing Board, the Writing Framework for the I ( I92 National 
Assessment of Educational Progress builds upon two decades ol N Alii 1 
experience in large-scale direct writing assessment/" The Writing 
Framexoork includes six major objectives, 



Wri/my / rtwtrwork for the l l M2 N<j/mwm/ A^c^nwnl of I iluniliomil /'n^ir . I \V,i'.lnh|*lon I m N.iiinn.il 
Assessment (.invertiing Hoard, U S. Department ol Mucation)- 
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Students should: 



• write for a variety of purposes: informative, persuasive, 
and narrative 

• write on a variety of tasks and for many different audiences 

• write from a variety of stimulus materials and within different 
time constraints 

• generate, draft, evaluate, revise, and edit ideas and forms of 
expression in their writing 

• display effective choices in the organization of their writing, 
including detail to illustrate and elaborate their ideas and use 
of appropriate conventions of written English 

• value writing as a communicative activity 

In developing the framework, input was received from writing 
educators, policymakers, scholars, and major education organizations. 
Care was taken to incorporate important changes from past assessments 
that reflected findings and recommendations from recent research on 
writing instruction and assessment, as well as the experience of many state 
writing programs. Therefore, highlights of the 1992 writing assessment 
include: assessment of informative, persuasive, and narrative writing; 
a set of writing topics that incorporates a variety of stimulus materials, 
audiences, and forms of writing; expanded assessment time (25 minutes 
per prompt at grades 4, 8, and 12, with some eighth and twelfth graders 
receiving a 50-minute task); a special page accompanying each topic for 
students to plan and organize their writing; enhanced six-point primary- 
trait scoring criteria; and a special writing portfolio study at grades 4 and 8. 

The Assessment Design 

Design and development of the 1992 writing assessment was managed by 
Educational Testing Service, whose staff worked with the 1992 Writing Task 
Development Committee composed of distinguished experts in writing 
education and assessment. To ensure continuity with the 1992 NAEP 
Writing Framework, the 10-member Development Committee included 
consultants who had worked on the Framework Committee. 

For the main 1992 writing assessment, each student received an 
assessment booklet containing a set of general background questions, either 



172 



177 



one or two writing tasks, a set of subject-specific background questions, 
and a set of questions about his or her motivation and familiarity with 
the assessment materials. Each writing task was a section, or block, of 
assessment time. Students were given either two 25-minute blocks or 
one 50-minute block, with the longer blocks used for some tasks assigned 
at grades 8 and 12. 

The 1992 writing assessment also involved "The Nation's Writing 
Portfolio," a study of students' classroom-based writing, winch was piloted 
in 1990. 28 For this portion of the assessment, a subsample of the fourth and 
eighth graders who participated in the timed portion of the assessment was 
asked to work with their teachers to complete questionnaires and submit 
three pieces of their best writing to NAEP for subsequent analysis. The 1992 
portfolio component was expanded from the 1990 pilot effort to include: 
1) a concerted effort to provide advance notice to teachers, 2) production 
of actual portfolio folders to collect students' written work, 3) student 
selection of their three best pieces for the portfolio rather than one, 
4) student letters explaining their selections, and 5) teacher questionnaires 
about the instruction associated with each of the student papers. 

The 1992 assessment was based on an adaptation of matrix sampling 
called balanced incomplete block (BIB) spiraling — a design that enabled 
coverage of the purposes for writing while minimizing the burden for any 
one student. The balanced incomplete block part of the design assigns the 
blocks of questions to booklets in a way that provides for position effect, 
complete balancing within each writing purpose, and partial balancing 
across writing purposes. The spiraling part of the method cycles the 
booklets for administration, so that typically only a few students in any 
assessment session receive the same booklet. 



National Sampling and Data Collection 

Sampling and data collection activities for the 1992 NAEP assessment 
were conducted by a well-trained field staff from Westat, Inc. In l c > >2, 
the assessment was conducted from January through March, with some 
make-up sessions in early April. 



Hlentile, C, t'\ploriu$ New Met hoik for C e//iv/iH,y Stutlont>' School /ww*</ IVrifm.v MAI /' •■ /■■■»■» 
\ 'orifoho Study (Washington, DC: N.ilion.il Center for Kliu.ihon SUtislu s, US l m\ fimiuiU I 'i tut u i>* a 
Office, 1W2). 
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As with all NAEP national assessments, the results for the national 
samples were based on a stratified, three-stage sampling plan. The first 
stage included defining geographic primary sampling units (PSUs), which 
are typically groups of contiguous counties, but sometimes a single county; 
classifying the PSUs into strata defined by region and community type; and 
then randomly selecting PSUs. For each grade, the second stage included 
listing, classifying, and randomly selecting schools, both public and 
private, within each PSU selected at the first stage. The third stage 
involved randomly selecting students within a school for participation. 
Some students who were selected (about 7 to 8 percent) were excluded 
because of limited English proficiency or severe disability. 



LEP and IEP Students 

It is NAEP's intent to assess all selected students. Therefore, all selected 
students who are capable of participating in the assessment should be 
assessed. However, some students sampled for partio'pation in NAEP 
can be excused from the sample according to careful* / defined criteria. 
Specifically, some of the students identified as having Limited English 
Proficiency (LEP) or having an Individualized Education Plan (IEP) may 
be incapable of participating meaningfully in the assessment. These 
students are identified as follows: 

LLP students may be excluded if: 

• The student is a native speaker of a language other than 
English; AND 

• He or she has been enrolled in an English-speaking school for less 
than two years; AND 



The student is judged to be incapable of taking part in 
the assessment. 



erJc 



IEP students may be excluded if: 

• The student is mainstreamed less than 50 percent of the time in 
academic subjects and is judged to be incapable of taking part in the 
assessment, OR 

• The IEP team has determined that the student is incapable of taking 
part meaningfully in the assessment. 
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When there is doubt, the student is included in the assessment. For 
each student excused from the assessment, school personnel complete a 
questionnaire about the characteristics of that student and the reason for 
exclusion. Although these data, like all NAEP information, do not identify 
individuals, they do permit profiles of the excluded students as a group. 
Approximately 7 to 8 percent of the students nationally were excluded 
from the assessment. 



Data Analysis and Weighting 

After the assessment information had been compiled in the database, the 
data were weighted according to the population structure. The weighting 
for the national sample reflected the probability of selection for each student 
as a result of the sampling design, adjusted for nonresponse. Through 
poststratification, the weighting assured that the representation of certain 
subpopulations corresponded to figures from the U.S. Census and the 
Current Population Survey. :u 



NAEP Reporting Groups 

This report contains results for groups of students within the nation defined 
by certain demographic characteristics. The definitions for subgroups, used 
in all NAEP assessments, as defined by gender, race/ethnicity, parents' 
education level, geographic region, and type of community follows. 

Gender. Results are reported separately for males and females. Gender 
was reported by the student. 

Race/Ethnicity. Results are presented for students of different racial/ 
ethnic groups according to the following mutually exclusive categories: 
White, Black, Hispanic, Asian/Pacific Islander, and American Indian 
(including Alaskan Native). Some racial/ethnic results are not reported 



'Tor additional information about the use ot wei^hm^; pioi eilures in NAIT, see Johnson, I : C, 
"Considerations and Techniques for the Analysis o\ NAM' Data," founutl of hlucttlional Slalt>ltfs 
(December 1989). 
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separately because there were too few students in the classification. 
However, the data for all students, regardless of whether their racial/ 
ethnic group was reported separately, were included in computing the 
overall results. 

Parents' Education Level. Students were asked to indicate the extent of 
schooling for each of their parents — did not finish high school, graduated 
from high school, had some education after high school, or graduated from 
college. The response indicating the highest level of education for either 
parent was selected for reporting. 

Geographic Region. The United States has been divided into four regions: 
Northeast, Southeast, Central, and West. 

Type of Community. Results are provided for three mutually exclusive 
community types — advantaged urban, disadvantaged urban, and extreme 
rural — areas that typically reveal differences in students' performance. The 
definitions of these areas follows. 

Advantaged Urban: Students in this group reside in metropolitan 
statistical areas and attend schools where a high proportion of the 
students' parents are in professional or managerial positions. 

Disadvantaged Urban: Students in this group reside in metropolitan 
statistical areas and attend schools where a high proportion of the 
students' parents are on welfare or are not regularly employed. 

Extreme Rural: Students in this group do not reside in metropolitan 
statistical areas. They attend schools in areas with a population 
below 10,000 where many of the students' parents are farmers or 
farm workers. 
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Tables C.l and C.2 present information about the percentages of 
students who particpated in the main writing assessment and the portfolio 
subsample according to the NAEP reporting groups. 



Table C.l 










Percentages of Fourth Graders Participating 






in Main Writing Assessment and Portfolio Study* 










Students 


Students 




oiUuBniS In 


Students in 


Submitting 


Submitting 




Main Writino 


Portfolio 


ti a 1 1 an t c 


informative 




Assessment 


Study 


Papers 


Papers 


Gender 










Male 


49 (0.5) 


48(1.7) 


47 (2.1) 


48(1.8) 


Female 


51 (0.5) 


52(1.7) 


53 (2.1) 


52(1.8) 


Race/Ethnicity 










White 


70 (0.2) 


72 (0.9) 


74(1.4) 


71 (1.1) 


Black 


16(0.1) 


14(0.8) 


13(1.2) 


15(0.9) 


Hispanic 


9 (0.2) 


9 (0.6) 


9 (0.8) 


9 (0.7) 


Other 


4 (0.2) 


4 (0.4) 


4 (0.4) 


4 (0.5) 


Parents' Level 










of Education 










College 


41 (1.0) 


39(1.7) 


39(1.9) 


42 (2.1) 


Some Ed. after H.S. 


9 (0.4) 


10(1.0) 


9(1.0) 


10(1.1) 


H.S. Grad 


14(0.5) 


13(1.0) 


14(1.2) 


13(1.1) 


Less than H.S. 


4 (0.3) 


4(0 7) 


4 (0.7) 


4 (0.7) 


Unknown 


32 (0.8) 


34(1.4) 


33(1.6) 


00 \ 1 .OJ 


Geographic Regions 










Northeast 


21 (0.8) 


22(1.1) 


23(1.2) 


23(1.6) 


Southeast 


23 (0.7) 


24 (0.8) 


24(1.1) 


24(1.0) 


Central 


28 (0.6) 


28(0.7) 


28(1.1) 


28(1.3) 


West 


28 (0.7) 


26(1.0) 


26(1.6) 


25(1.4) 


Type of Community 










Advantaged Urban 


11(1.7) 


12(1.9) 


13(2.3) 


12(2.0) 


Disadvantaged Urban 


8(1.1) 


7(1.0) 


6(1.0) 


8(1.1) 


Extreme Rural 


10(2.2) 


11(2.4) 


12 (2.8) 


11 (2.2) 


Other 


70 (2.9) 


70(3.1) 


68 (2.8) 


69 (3.2) 


Type of School 










Public 


87(1.2) 


87(1.1) 


87(1.5) 


87(1.2) 


Private 


12(1.0) 


13(1.1) 


13(1.2) 


13(1.1) 



*Duc to rounding, percentages may not equal 1(10 
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table C2 










Percentages of Eighth Graders Participating 

in Main Writing Assessment and Portfolio Study* 






Students in 
Main Writing 
Assessment 


Students in 
Portfolio 
Study 


Students 
Submitting 
Narrative 
Papers 


Students 
Submitting 
Informative 
Papers 


Gender 
Male 
Female 


50 (0.5) 
50 (0.5) 


51 (1.6) 
49 (1.6) 


50 (2.0) 
50 (2.00) 


52(1.6) 

Ho \ 1 .OJ 


Race/Ethnicity 
White 
Black 
Hispanic 
Other 


70 (0.2) 
16(0.1) 
10(0.2) 
4 (0.2) 


73 (1.2) 
14(0.9) 
9 (0.7) 
4 (0.4) 


76(1.3) 
12(0.9) 
8 (0.9) 
4 (0.5) 


72(1.3) 
15(1.1) 
9(0.8) 
4 (0.6) 


Parents' Level 
of Education 
College 

Some Ed. after H.S. 
H.S. Grad 
Less than H.S. 
Unknown 


40 (1.1) 
20 (0.6) 
25 (0.8) 
8 (0.4) 
8 (0.4) 


42 (1.7) 
20 (1.4) 
25 (1.1) 

6 (0.9) 

7 (0.8) 


42 (2.0) 
21 (1.9) 
25(1.5) 
5(1.1) 
7(1.0) 


41 (2.0) 
21 (1.6) 
25(1.4) 
6(1.1) 


Geographic Regions 
Northeast 

Qrki ithoact 
OUUUlCdM 

Central 
West 


22 (0.7) 
25 (0.5) 
25 (0.5) 
28 (0.5) 


22(1.9) 
27 (1 2) 
24(1.3) 
27(1.1) 


21 (1.7) 
28(1.7) 
23(1.6) 
28 (2.1) 


23 (2.2) 
27(1.7) 
24(1.7) 

OS M R\ 
dO \ 1 .0) 


Type of Community 
Advantaged Urban 
Disadvantaged Urban 
Extreme Rural 
Other 


9(1.6) 
10(1.4) 

9 (2.4) 
72 (3.0) 


9(1.5) 
9(1-2) 
10(2.8) 
73 (3.1) 


9(1.4) 
8(1.2) 
10(2.3) 
74 (3.2) 


8(1.6) 
9(1.3) 
10 (3.2) 
73 (3.8) 


Type of School 
Public 
Private 


89 (0.9) 
11 (0.9) 


88(1.0) 
13(0.8) 


88 (0.9) 
12(0.9) 


87(1.2) 
13(0.8) 



*Pue to refunding, percentages may not equal 100. 



Estimating Variability 

Because the statistics presented in this report are estimates of group and 
subgroup performance based on samples of students, rather than the 
values that could be calculated if every student in the nation answered 
every question, it is important to have measures of the degree of uncertainty 
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of the estimates. The variability of estimates of percentages of students 
having certain background characteristics or answering a certain cognitive 
question correctly is accounted for by the uncertainty due to sampling only 
a relatively small number of students. 

In addition to providing estimates of percentages of students, this 
report also provides information about the uncertainty of each statistic. 
Because NAEP uses complex sampling procedures, conventional formulas 
for estimating sampling variability that assume simple random sampling 
are inappropriate, so NAEP uses a jackknife replication procedure to 
estimate standard errors. The jackknife standard error provides a reasonable 
measure of uncertainty for any information about students that cannot be 
observed without error. 30 The jackknife method of estimating variances 
will correctly estimate variances as long as the data are independent at the 
Primary Sampling Unit level. In the population of papers, any correlations 
between papers of the same person are all taken into account by the 
jackknife technique. 

The reader is reminded that, like those from all surveys, NAEP results 
are also subject to other kinds of errors including the effects of necessarily 
imperfect adjustment for student and school nonresponse and other largely 
unknowable effects associated with the particular instrumentation and data 
collection methods used. Nonsampling errors can be attributed to a number 
of sources: inability to obtain complete information about all selected 
students in all selected schools in the sample (some students or schools 
refused to participate, or students participated but answered only certain 
items); ambiguous definitions; differences in interpreting questions; 
inability or unwillingness to give correct information; mistakes in recording, 
coding, or scoring data; and other errors of collecting, processing, sampling, 
and estimating missing data. The extent of nonsampling errors is difficult to 
estimate. By their nature, the impacts of such error cannot be reflected in the 
data-based estimates of uncertainty provided in NAEP reports. 



"Tor further details, sec Johnson, K. CJ., "Considerations and Techniques for the Analysis of NAM' 
Data," font tut i of l\lm at tonal Sfafjs//V.s (Winter 
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Drawing Inferences from the Results 



The use of confidence intervals, based on the standard errors, provides a 
way to make inferences about the population means and percentages in a 
manner that reflects the uncertainty associated with the sample estimates. 
An estimated sample mean or percentage ± 2 standard errors represents a 
95 percent confidence interval for the corresponding population quantity. 
This means that with approximately 95 percent certainty, the average 
performance of the entire population of interest is within ± 2 standard 
errors of the sample mean or percentage. 

Confidence intervals can be constructed for percentages, provided that 
the percentages are not extremely large (greater than 90) or extremely small 
(less than 10). For extreme percentages, confidence intervals may not be 
appropriate. However, procedures for obtaining accurate confidence 
intervals are quite complicated. Thus, comparisons involving extreme 
percentages should be interpreted with this in mind. 

To determine whether there is a real difference between the mean or 
percentage (or proportion of a certain attribute) for two groups in the 
population, one needs to obtain an estimate of the degree of uncertainty 
associated with the difference between the percentages, means, or 
proportions of these groups for the sample. This estimate of the degree 
of uncertainty — called the standard error of the difference between the 
groups — is obtained by taking the square of each group's standard error, 
summing these squared standard errors, and then taking the square root 
of this sum. 

Similar to the manner in which the standard error for an individual 
group mean or proportion is used, the standard error of the difference 
can be used to help determine whether differences between groups in 
the population are real. The difference between the mean percentage or 
proportion of the two groups ± 2 standard errors of the difference 
represents an approximate 95 percent confidence interval. If the resulting 
interval includes zero, there is insufficient evidence to claim a real difference 
between groups in the population. If the interval does not contain zero, 
the difference between groups is statistically significant (different) at the 
.05 level. 

The procedures described in this section, and the certainty ascribed 
to intervals (e.g., a 95 percent confidence interval) are based on statistical 
theory that assumes that only one confidence interval or test of statistical 
significance is being performed. When one considers sets of confidence 
intervals, like those for the average percentages of different racial/ethnic 
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groups, statistical theory indicates that the certainty associated with the 
entire set of intervals is less than that attributable to each individual 
comparison from the set. If one wants to hold the certainty level for a 
specific set of comparisons at a particular level (e.g., .95), adjustments 
(called multiple-comparisons procedures) need to be made. 

The standard errors for means and proportions reported by N AFP 
are statistics and subject to a certain degree of uncertainty. In certain cases, 
typically when the standard error is based on a small number of students or 
when the group of students is enrolled in a small number of schools, the 
amount of uncertainty associated with the standard errors may be quite 
large. Throughout this report, estimates of standard errors subject to a 
large degree of uncertainty are designated by the symbol "!". In such cases, 
the standard errors — and any confidence intervals or significance tests 
involving these standard errors — should be interpreted cautiously. 



Evaluating Students' Portfolios 

The national committee and NAEP staff who designed the NAEP portfolio 
study explored several approaches to evaluating students' portfolios. First, 
the committee considered assigning a common task in addition to collecting 
examples of students' regular classroom-based writing. Since the main 
NAEP writing assessment already contained a range of assigned tasks, the 
committee chose instead to focus on collecting multiple samples of students' 
classroom work. 

Asking students to select three samples of their classroom-based 
writing opened the door to a wide range of possibilities. Student A's 
portfolio might contain three stories while student B might send in three 
informative pieces. Student C might include one persuasive letter while 
student D might submit three stories, two informative pieces, and one 
persuasive essay. The question then became how to compare the wide 
variety of portfolios submitted. Developing a means for evaluating such 
different portfolios in a way that would provide meaningful comparisons 
between students' performance was virtually impossible without more 
information about the students and their classroom experiences. 

To this end, the committee and NAEP staff attempted to collect 
information from the participating students and teachers that would permit 
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a classification of students' classroom experiences. A teacher questionnaire 
was designed to collect consistent information from teachers about a variety 
of factors related to the students' submissions and the classroom writing 
activities. In order to collect additional information, students were asked 
to write a letter describing their submissions. I lowever, the amount and 
quality of information actually provided by teachers and students varied 
greatly, making it difficult to develop adequate ways of classifying students' 
classroom experiences. 

Without a consistent understanding of students' classroom experiences, 
the development of an overall evaluative* rating for students' portfolios and 
a comparison of their performance was not possible. Instead, NAEP focused 
on what the portfolios could tell us about students' abilities to write the 
various types of pieces they submitted in their portfolios. 

Because the majority of the writing submitted was informative and 
narrative, these domains were selected for evaluation. Although few 
students submitted persuasive pieces, their persuasive writing was also 
evaluated as a means of broadening the types of writing evaluated. Poetry, 
thank you letters, and skill sheets were not evaluated because they did not 
represent extensive pieces of writing and also because so few students 
included them in their portfolios. Thus, evaluative guides were developed 
for students' informative, narrative, and persuasive writing. 

Developing Evaluative Guides 

For its regular writing assessments, NAEP typically develops specific 
scoring guides for each of its writing prompts. The limitations of this 
approach for evaluating diverse samples of school-based writing are 
obvious. With more than 250 classrooms involved in this study, developing 
a scoring guide for each unique assignment would have been impossible. 
As part of its 1990 pilot study of students' classroom-based writing, NAEP 
developed scoring guides specific to each of the major domains: narrative, 
informative, and persuasive. A brief description of this process follows. 

Using samples of the student writing, NAEP staff worked with a team 
of elementary teachers, secondary teachers, and teacher educators to 
develop scoring guides. The process the team of teachers used to develop 
the guides involved three major stages: reading and sorting; classifying and 
consensus; and describing and confirming. 
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Reading and Sorting. Beginning with the informative pieces, the team 
first read approximately 60 randomly selected papers from each grade level, 
which comprised about 10 percent of all the informative papers. Based on a 
general, holistic impression, team members sorted the papers into four to six 
groups ranging from highest to lowest. 

This stage involved confirming that all of the papers first classified as 
informative were genuinely informative. The team defined informative as 
those papers that had, implicitly or explicitly, the purpose of conveying 
information or ideas. Thank you letters and opinion statements are 
examples of some of the papers that were reclassified because their 
purposes were not primarily informative. Also, papers in which the teacher 
provided students with the first sentence to each paragraph seemed more 
like elaborate fill-in-the-blank worksheets than original papers. These were 
reclassified as skill sheets. 

Classifying and Consensus. Next, the team compared the way they each 
had sorted the papers, discussing which papers represented high, medium, 
and low levels of performance. In the process, they discussed a range of 
criteria that could be used to evaluate writing in general and informative 
writing in particular. Their goal was to identify levels of development in 
informative writing. 

To this end, the team decided to focus on the cognitive elements of 
the papers. When rereading the papers, they asked three questions: "How 
much information is the student conveying in the paper?" "What kinds of 
relationships do the writers establish between the ideas and information?" 
and "How developed are the ideas and information?" 

As the discussion progressed, the team members articulated the 
criteria they each had used to place papers into categories. This discussion 
continued until a common set of criteria could be agreed upon and 
specified. For informative writing, the criteria related to the clarity with 
which students presented information and ideas, and the ways thev 
organized or related their information and ideas. 

Describing and Confirming. Using the common set of criteria, the team 
then described a range of performance for informative writing. Papers that 
exemplified each level of performance were selected. The loam then applied 
the criteria to a new set of papers from each grade (another 10 percent of the 
informative papers), refining their descriptions. 
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At first, the fourth- and eighth-grade papers were read separately, 
the plan was to develop different guides for each grade. However, after the 
informative guide had been developed for the fourth-grade papers, and the 
group moved on to consider the eighth-grade informative pieces, they 
found that the same criteria could be applied to both grades. 

The procedures outlined above were also used to develop scoring 
guides for the narrative and persuasive pieces. Narrative papers were 
defined as pieces that described a sequence of events, real, or imagined. 
Persuasive papers were those letters, paragraphs, or essays that stated a 
position or opinion primarily for the purpose of persuading or convincing. 
The idea of developing one generic scoring guide for all papers was 
discussed. However, the scoring guide development team concluded that 
the purposes and methods of development for the three domains were so 
different that they required separate sets of criteria for evaluation. 

In 1992, these scoring guides were reviewed and revised, based on 
NAEP's experience in 1990 and a preliminary analysis of the students' 1992 
portfolio writing. The scoring guides for informative and narrative writing 
remained the same. However, the persuasive guide was revised to better 
capture the range of argumentation in students' persuasive writing. 

In 1990, the team considered refutation of an opposing viewpoint as 
essential to advanced persuasive discourse and included this in the fifth and 
the sixth levels of the persuasive scoring guide. A preliminary analysis of 
the students' portfolio writing in 1992 revealed that students' persuasive 
arguments might be elaborated, yet not include elements of refutation. 
Therefore, the fifth and sixth levels of the persuasive guide were changed 
to represent more advanced types of argumentation that did not necessarily 
have to include refutation. 

It is important to note that the panel that developed the scoring guides 
relied on their experience as teachers and teacher educators to establish the 
upper ends of the three scales. They felt it was possible and desirable to 
project, based on their own knowledge of written discourse (and also on the 
few upper-range papers submitted), the key features of complex narrative, 
informative, and persuasive writing. Also, it should be noted that creativity, 
as an aspect of writing separate from development, was not represented in 
the scoring guides used for this study. 
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Applying the Evaluative Guides 



Scoring the Writing. Using the scoring guides specially designed for the 
study, a group of readers was trained to apply the scoring guides to 
students' portfolio submissions. The readers had extensive experience in 
scoring students' writing, but they were not necessarily writing specialists 
or practicing teachers. The four-day training consisted of four main 
elements: (1) introduction to the student portfolios; (2) writing process and 
domain knowledge development; (3) explanation of the scoring guides; and 
(4) practice at applying the scoring guides. 

On the first day of training, the readers were introduced to examples 
of student portfolios, the Teacher Questionnaire (see Appendix D) and the 
Descriptive Coding Sheet developed for the portfolio scoring in this study. 
Using the practice portfolios, the scorers examined a number of portfolios 
and were trained in specific procedures for using the Descriptive Coding 
Sheet. (Two areas that required in-depth training across the four days 
were Evidence of Process and Types of Writing.) 

Later on the first day, an overview of process approaches to writing 
instruction was presented in order to provide readers with enough 
information about writing process to enable them to look reliably for 
evidence of writing process when scoring the actual folders. First, the 
readers were provided with an outline of writing process theories and 
a previewing guide for a video tape about writing process. The basic 
tenets and instructional procedures of process writing approaches were 
presented. 31 The readers then viewed a video tape of a classroom where 
writing process was implemented. This was followed by practice scoring 
using the Descriptive Coding Sheet. 

On the second day, an overview of the three classifications of writing 
was presented: narrative, expository, and persuasive. Major elements of 
narrative discourse structure were presented. Readers received instruction 
in story grammar methods for describing various story elements- 12 and in the 
major narrative forms and their defining characteristics." Using a number of 



" Boo n ks d 1983j rnVtS ' Tmhm CHMm> "' W ° rk ' iEXCl "' NH: Hcinemann Educational 

*N. Stein and C. Glenn, "An Analysis of Story Comprehension in Elementary School Children," in 
New Directions in Discourse, R. Freedle, editor (Norwood, NJ: AI3LEX, 1979). 

"Donnld j. Leu and Charles K. Kin/er, Kffectivc Reading Instruct*,,. K-8, (New York, NY: Maarillan 
Publishing Company, 1991 ) iau«ina.i 
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examples at each grade, readers identified the major elements of narrative 
story structure. They then scored samples of fourth- and eighth-grade 
children's stories from theNAEP 1990 Portfolio Study using the Narrative 
Scoring Guide. 

On the third day, expository text structure was presented and on the 
fourth day, persuasive text structure was presented.* 4 The same procedures 
as had been used for narrative texts were used to educate readers about 
expository and persuasive text structure. After a final review, readers then 
proceeded to code the students' portfolios and evaluate any narrative, 
informative, and persuasive writing found in students' folders. Their work 
was supervised by specially trained table leaders, who constantly checked 
on individual scorer's activities. 

Interrater Agreement. Thirty percent of the papers in each domain 
received a blind second scoring — the second reader could not see the score 
given to the paper by the first reader. Table C.3 presents the rate of reliability 
and agreement between the two readers. 

The reliability coefficient is a correlation between the scores assigned 
to papers by the first and second readers, taking into account not only when 
two scorers disagreed but also the size of their disagreement. In assessment 
programs or research projects where results are not reported by student, 
coefficients above 0.60 are considered acceptable. 

When using a six-point scale, agreement within one score point, which 
is called adjacent agreement, is calculated because increasing the size of the 
scale requires that readers make more refined distinctions between each 
level. With a six-level scoring guide, any percentage adjacent agreement 
above 90 percent is considered strong. The percent exact agreement is also 
presented in Table C.2. Exact reliabilities in the 50-60 percent range are 
somewhat low, due in part to factors discussed below. 



*Vau\i. U.I. and Varca. I 1 ..Contrttl Arm Rahtitt£. 'Ihtni lithium (Uenview, IL: Scoll, Forvsman and 
Company, IW) 




Table C3 



lnterrater Reliabilities and 
Percent Adjacent Agreement 





n_.u_i.iii a. » 

Reliability 
Coefficient 


Percent Adjacent 
Agreement 


Percent Exact 
Agreement 


Narrative 
Fourth 


n cn 

0.59 


no 
98 


Ci 
Dl 


Eighth 


0.62 


93 


53 


Informative 
Fourth 


0.66 


96 


58 


Eighth 


0.68 


93 


53 


Persuasive 
Fourth 


0.41* 


93* 


67* 


Eighth 


0.61 


90 


52 


Overall Scoring 
Fourth 


0.65 


97 


56 


Eighth 


0.66 


93 


53 



* Interpret the fourth-grade persuasive category with caution due to 
the small sample size. 

Note: Thi* scoring was based on a six-point scale. 

SOURCE: National Assessment of Educational Progress (NAEE), 
1992 Writing Assessment 



If it had been possible to sort students' portfolio submission^ \f\io 
the three domains and then have readers evaluate each domain dl r £dly 
after they received training on that domains' scoring guide, internet 
reliabilities probably would have been higher. However, this met^d was 
not logistically feasible because of the difficulty in managing the V~ge 
numbers of papers submitted. Instead, readers received training tyt how to 
record various descriptive aspects of students' portfolios (coding) fnd how 
to evaluate three types of writing (scoring). Then, they began to c^leand 
score students' portfolios. 

This method enabled readers to work with one folder at a tii%L thus 
maximizing coding accuracy, but not optimizing interrater agree^nt for 
scoring. Given the complexity of coding and scoring students' portfolios, 
the use of 6-level spring guides, and the great variety in students writing 
(even within each domain), the reliabilities achieved in this study fall within 
acceptable limits. For future studies of this type, procedures for imaging 
portfolio folders and maximizing interrater reliability need to be ^omitted. 
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Appendix D 

Administration Materials 

1. Fall Announcement to Schools 

2. Directions to Teachers 

3. Cover of Portfolio Folder — Directions to Students 

4. Teacher Questionnaire 
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1. Fall Announcement to Schools 



Dear Principal and NAEP School Coordinator: 

Many thanks for your cooperation in NAEP's 1992 assessment. The participation of 
schools like yours in NAEP enables us to develop innovative assessments, from which 
teachers can draw information pertinent fo? their promotion of students' thinking and 
learning. 

Following up on the introductory materials you recieved about the 1992 assessment, 1 am 
enclosing further information on the two new components of NAEP 1992: assessments of 
students reading aloud and their school-based writing. 

The Integrated Reading Performance Record. A small number of fourth grade students 
taking NAEP's reading assessment will be selected to participate in an audiotaped 
interview during which they read aloud. Each student will be invited to bring his or her 
favorite book to this post-assessment interview, read aloud, and answer a few questions 
about reading preferences. As with all of NAEP, the information on the important skills 
of reading aloud will be analyzed and reported for the nation; no student names will be 
collected. 

The Nation's Writing Portfolio. A small number of fourth- and eighth-grade students 
taking NAEP's writing assessment will be selected to participate in collection of school- 
based writing. In the fall, teachers and students will begin collecting writing that 
students have completed for their English or language arts classes. At the time of the 
writing assessment, students will review their work and choose the three best pieces. 
(For each of approximately three students selected to participate, teachers will be asked 
to take a few minutes to fill out a brief questionaire describing the assignment that led to 
each student's writing.) 

In preparing for the Writing Portfolio study, it would be most helpful if you rouid uilvUi 1 
your fourth grade teachers and eighth-grade English or language arts teachers to hv\\\\\ 
putting aside the school-based writing in which they and their students take the most 
pride. 

At assessment time, as you speak with the students who will participate in NAI I 1 , please 
feel free and encourage them to give their very best efforts on the National AwsMitcni, 
which is the nation's only ongoing monitor of the academic achievement of our 
elementary, junior high, and higu school students. By participating in NAI V voui 
students arc making history! 

We, in turn, will send you and your teachers copies of the reports of the^e mnovumr 
national assessments. 

aVs always, your generous cooperation is most appreciated. 
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2. Directions to Teachers 



THE I 
REPORT 
CARD 

Dear Fourth- and Eighth-Grade Teachers, 

The National Assessment of Educational Progress (NAEP) is conducting a 
special project this year, called The Nation's Portfolio, to provide information 
about the writing students do in school. The students whose names appear on 
the attached folders have been selected to participate and we are asking for 
your cooperation and assistance at the following three stages of the project. 

COLLECTING: If students have not already saved samples of the writing 
they have done for their language arts or English classes throughout the 
school year, please have them assemble as much of their work as possible. 

SELECTING: Help the students whose names appear on the attached 
Portfolio Folders review the writing they have collected and select THREE 
pieces of writing that represent: 

■ their BEST writing effort; 

■ a RANGE of types of writing tasks (such as stories, reports, 
essays, persuasive pieces); ancT 

■ the use of WRITING PROCESS strategies (such as successive 
drafts, use of reference sources, and peer review). 

DESCRIBING: After helping students make their selections, have them write 
a letter to us explaining why they chose their three pieces and what they like 
about them. Then, have them place copies of their three pieces of writing 
and their letters in the Portfolio Folders. 

Next, to help us to better understand the students' selections, please fill out 
the brief questionnaire located inside each student's Portfolio Folder. The 
students' Portfolio Folders will be collected by the NAEP administrator on 
the date of the regular NAEP writing assessment. 

Thank you for participating in The Nation's Portfolio and for helping us 
develop innovative methods of writing assessment that reflect the richness and 
diversity of students' classroom writing. 

We arc sorry, but we will not be able to return the schoolwork you provide. Please send copies of 
students' work if you do not want us to keep the originals. 
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3. Cover of Portfolio Folder — 



Directions to Students 



Student Directions 
(to be printed on the cover of each students' portfolio folder) 

PORTFOLIO FOLDER 

Student Identification Number: - 

Dear Student, 

Thank you for being a part of The Nation's Portfolio, Your work will help 
schools across the country improve the way students' writing is tested. 

Please review the writing you have done for your language arts or English 
class so far this year and select THREE pieces that: 

* represent your BEST writing effort; 

* represent a RANGE of types of writing tasks (such as stories, 
reports, essays, persuasive pieces); and 

* represent the use of WRITING PROCESS strategies (such as 
doing pre-writing activities, revising your papers, sharing your 
papers with classmates). 

After you select three pieces, write a letter to us telling us 

* WHY YOU SELECTED each of these pieces; 

* WHAT YOU LIKED about each of them; and 

* WHAT THEY SHOW about you as a writer. 

Thank you for being a part of The Nation's Portfolio. 



ERLC 



1»>2 

10G 



4. Teacher Questionnaire 



Teacher Response Sheet 
(printed on separate page to go inside each Portfolio Folder) 



Student Identification Number: 



THE FIRST SELECTION 

How much time did the student spend working on this piece of writing? 



Please briefly describe the assignment for which this piece was written. 



Please briefly describe any instructional activities that were associated with this 
assignment (for example, freewriting, peer discussion, drafting, revising). 



THE SECOND SELECTION 

How much time did the student spend working on this piece of writing? 



Please briefly describe the assignment for which this piece was written. 
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Please briefly describe any instructional activities that were associated with this 
assignment (for example, freewriting, peer discussion, drafting, revising). 



THE THIRD SELECTION 

How much time did the student spend working on this piece of writing? 



Please briefly describe the assignment for which this piece was written. 



Please briefly describe any instructional activities that were associated with this 
assignment (for example, freewriting, peer discussion, drafting, revising). 



Additional Comments: 
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Appendix E 



Examples of Students' Portfolio Writing 



1. Narrative Writing 

2. Informative Writing 

3. Persuasive Writing 

4. Poems 

5. Letters 

6. Skill Sheets 
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1. Narrative Writing 



The following examples illustrate the range of stories submitted by the 
students who participated in this study. The students' papers are arranged 
according to the scores they received when they were evaluated. Each set 
of samples is preceded by an explanation of how these papers fit into the 
corresponding category. 

1: Event Description. The two papers below are examples of Event 
Descriptions. They describe a single happening, rather than a series 
of events. 



Example #1 (Fourth Grade) 







..JL 



. XXL 
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Example #2 (Fourth Grade) 




"f"^ ->r-.=-J — =»~U — 




CO 



Ljgr.-W A Lua3 a \o\- c£ gun ue . 

. as>dt .Qv \ oV ol patsofl oak H_ Wi . 

Kv\- r\C -fittN flr\Ol T" gaQ UJ 0, ree l - . 
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2: Undeveloped Story. The two papers below are examples of 
Undeveloped Stories. These stories are a series of events, but the events, as 
well as the setting and characters, are only briefly described. These stories 
are similar to front-page newspaper reports, where the basic facts of a story 
are reported (who, what, when, where) but few details are presented about 
why events happened. 



Example #1 (Fourth Grade) 



THE HOUSE CN NAr : LE STREET 



n LUMu TIME AGO. T HE SEVILLE3 LIVED HAPPILY. BUT IN THE 
L^Ij r f"F..'J CAYS THERE WERE ROBBIES OF ROC? ET BOOSTERS FROM 
'IAIJm.TIiE SEVZL^IES DIDN'T t NOW THEIR } IDS CMIKE AND KATE ] WERE 
Tilt rxUDDEr.tf' 

NI* E hVJD 1 ATE WERE T HE INTERESTED IN ROCHET ROCKET 
•<QU3 "> L* K ;J . THE-* THE ROCKETS UNDER A COVER IN THE BA3EMENT, 

Mi?E ■ ATE CONN ITT ED SIX MORE ROBBER T . NOW THEY HAD 

IWENIY RG:.: ET l-OCSTERS. 

T.'L'IR - *rENTE WERE J R R I E D . M I } E AND I ATE bOT BAD GRADES 



in :;ch;: 



ACH 



N ; S . 



; th c ■ 9. . 

"ILY L r JC: 



LIKE THIS 





lI 



I 1 I 

! ■ I . 



■il } 



•Ml ' i 
. . i l 



'■ WA'.S A f ; FECT L I FT-UFF ! 
" ' » M R BTF.A1 UFPHERE. 
■ Ml'vli K HIT A ROCKET BOOSTER! 

> a j 1 1 imt, 

' M AID MM E. 

'MM-. AI y s - .si. 1 * SAID I ATE . 
i-. ! "RENT'S WILL K ILL US!" 

. - -fl i jj NtJ " 
II IHt :3 I V I t.LES CAM'.I HOME ! 

• •IP NR3. SEVILLE. 

' nil' E . 



THE HOUSE 
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Example #2 (Fourth Grade) 

J/ Cj€£> miCu-vaJA- Orcjzls iido^* rrrtbsvvy Jukk> 

,tSui^ ajl^u. roviy *lo'& p^^v #a/ty 

9iujA, jluiJUL art* ZrAsyiAJm. is^sb. g lu 2 Qz, 
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3: Basic Story. The two papers below are examples of Basic Stories. In 
these stories, the writers describe a series of events and go beyond a simple 
list of related events. Some aspect of the story (the events, the characters' 
goals, or the setting) are somewhat developed. However, these stories lack a 
sense of cohesion and completeness. They may have problems with syntax 
or sequencing of events. 



Example #1 (Fourth Grade) 



/ 



d\isL McU wWSL cjLiad/j Ljvi, . ]Vjs 

J 
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/ryW&crc, ^rrut^- AV&Ivl ydst^/ Aa/OW- 
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Example #2 (Fourth Grade) 

WE GO ON THE TRAII 





99 



"It was a. hard tri^ 
on the ocean" said Mary. 
But this is even harder 
packing the covered wagon 
we have to pack food, 
clothing wood and water. 
We are in Pennsylvania 
we are going to N 
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I asked if I cou.!d 
bring Lady, our dog. M 
said, "yes". We are 
cooking lots of food like 
cabbage stew, roast beef 
fried chicken and turkey- 
boiled corn, corn mush, 
and milk. 
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\ 




W e are 
soap. Pa shot 
rabbits today, 
some deer too. 
we leave. 



making 
some 

He also ^ot 
Tomorrow 



Ma cooKed 
especially good food for 
dinner. We had chicken 
with gravy and salad with 
dressing a nd for dessert 
we had cherry pie and 
blueberry pie and 
raspberries. Today we 
start off I am so excited. 

204 



er|c 
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ME?" 




It is night now. Pa shot 
a buffalo it tasted so 
good. Pa said that we 
might cross the border 
tomorrow. 
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KJ 



Ma's fixing a bed 
for you in the wagon. 
My eyes popped open the 
next morning the first 
thing I thought was we 
are going to Nebraska. 
Suddenly Pa came in. He 
said "one of the oxen died 
during the night". He 
said that we would not 
make it with only three 

oxen so we would live 

here. 
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4: Extended Story. The two papers below are examples of Extended Stories. 
In these papers, many of the events are somewhat elaborated, giving the 
sense of a sequence of distinct story episodes. Details are given about the 
setting, the characters' goals, problems to be solved, and the key events. Yet, 
these stories are confusing or incomplete. The characters' goals may be left 
unresolved, the problem posed in the story's opening never solved. The 
ending may not match the beginning or the story's ending may be 
inconsistent with the internal logic established throughout the rest 
of the story. 



Example #1 (Eighth Grade) 

P^Mt. °^kt (^u^ -MMt zai^ QA 
toll CU> MuJolUv^> Mj^ ^xoW<m 

loJA <3u£ p^J< Osnd parole 

cUdJ^J M^J^ CurJ k** ^ 

| ^Aoo^A kCLoyJsnyoUd Ma- Cb/ 
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^<9 

/?/> 



y i*cut J5uu,yy ly^&J^ -^U^LjL 
( jjjLy Cl^O^M: X- <>J&* 
JXcuat- O. Qy^u^ Gsy^o r ^JCt& J?<7t&l^ 



2<U-ts^= Cd2c^ JjMs- 
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Example #2 (Eighth Grade) 



The bright, city lights shown all around the crowded, city streets as I 
stepped off the train from Kansas. Before 1 knew it, 1 had been sucked into 
the relentless crowd. All kinds of people were walking hurriedly towards 
their own destinations. An excitement of homecoming soldiers was evident 
as joyful looking expressions were portrayed on each individual s face. The 
paper's headlines all announced the return of the victorious swashbucklers. 
These combatants walked proudly along the streets with their heads held 
high in the air. 

Many enjoyed their Saturday off, while other steadfast laborers did 
not stop from their endless, fruitful exertions, Many of these tireless 
workers were moving crates of wine into the nearby tavern.- While other 
handymen were taking large sacks of grain from the back of an old truck to 
the bakery across the street. Sweat dripped from their squinting brows as 
they heaved the monstrous burdens up)bmto their brawny shoulders. Two 
men stood by the newstand looking over their crumpled newpapers as if 
they were Secret Service men watching for a criminal to step off the train. 
They had suspicious-looking faces as if they were undercover agents 
searching for some sort of clue. As my eyes lifted to the skyline of this 
strange city, I asked myself how in the world 1 was going to find my way 
around these entangled, city streets. With a little wish, hope, and a prayer 
I set out to find a place to stay. 

I shoved through that frantic mass of people, gasping for air as i 
reached the far side. I walked along the busy street looking in each of the 
dimly lit windows. I saw large men drinking beer and laughing m the 
tavern. I saw several mannequins dressed up in high class tuxedos and 
dresses. The next window I did not have to look in. I already knew that it 
had to be the bakery. I had smelled the sweet aroma of the hot, buttered 
bread drifting capriciously through the air. My mouth watered as 1 began 
to sense the taste of the delicious-looking bread. I had planned on finding 
a room before anything else was done, but the ambrosial scent of the bread 
allured me into the quaint, little boulangerie. I sat down over in an 
isolated corner, while I ate a loaf of delicious, French bread. As I gazed at 
my watch for a few minutes, I happened to notice the time. It was already 
five-thirty! I greedily scarfed down the rest of the bread while dashing 
out the door, In my carelessness, 1 swung the gate open and sent an old 
lady sprawling on the ground. Her groceries rolled all over the stony 
sidewalk and into the street. She scrambled to her feet as I helped put the 
items back in her bag. When apologies had been made. I dashed off 
towards the hotel. I decided to take a shortcut through a darkened 
alleyway to save time. Along the way 1 dodged many foul-smelling scrap 
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plica and the rats that accompanied them. The stench of mildewed garbage 
and scku drenched my clothes by the time 1 reached the end of the lane. 
This was no way to smeli where I was headedl I had to get cleaned up 
quick I 

I sprinted towards an antiquated building which read, 
Meadowview Inn." I threw open the door to find an old, run- down office 
filled with smoke, An old man sat smoking a cigar with his hat pulled over 
his eyes and his legs spread across his cluttered desk. A long string of bells 
clamored as the door slammed shut. The scratchy -faced man raised his 
head to look me over. All he said was, Twenty-nine fifty, you want the 
key, it s on the hook." This wasn't exactly the kind of place I had in mind, , 
but reluctantly I took the key and went upstairs. I coughed and choked o 
after f nhaling so much smoke. I could not cohcieve someone living with 
such a thick cloud hanging above them all the time. I climbed the stairs 
three at a time. I flung myself around the corner and ran the length of the 
hail, where I found my room. Out of breath and exhausted, I felt like 
falling into a deep sleep, but no. I had to continue. I had to complete my 
mission. I was in and out of the shower in no time. I threw my wrinkled 
clothes on and grabbed my leather jacket. In less than five minutes I was 
ready to go. I called my friend Jake and told him to meet me at the corner 
of Cornwallis Drive and Randall Avenue in two minutes. I gained my 
momentum once again as 1 raced frantically down the hall. I jumped on 
the banister and slid down to the bottom floor. I dashed through the cloud 
of smoke and out the front door. I shot the gaps through the crowd of 
people walking along the sidewalk. I became overcome with frustration 
when I found myself trapped behind a slow- moving, elderly couple. When 
I was about to reach my final destination, I felt a surge in my spirits 
because I knew I was about to complete my task. I saw Jake standing a 
block away waiting for my arrival. I slowed for a brief moment to catch 
my breath. In the corner of my eye I caught a glimpse of a big, bright, red 
sports car flying by in the far lane. I turned to see an outstretched arm 
pointing a gun out of the window. THE LAST THING I SAW WAS THE 
SHINY BARREL OF A 44 MAGNUM POINTING STRAIGHT AT MY HEAD. 
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5: Developed Story. The two samples below illustrate the Developed Story. 
These papers describe a sequence of episodes in which almost all of the 
events and story elements are somewhat elaborated. Yet, an aspect of these 
stories is not well developed, such as the ending or a crucial event. 



Example #1 (Eighth Grade) 




w nee in a pfoce where the trees touched the sky and the 

water qtistcned bfue, the most ma jestic creatures roamed, yy 
Emerald scaled dragons cCozexf lazily by the streams, and biros 
soared through the cfouefs, the sun g[ in t ing of/ their brifttaut 
ptumagc. There afso Lived unicorns with manes of silk, Carqp^ 
round sapphire eyes and wings of silvery spfeudor. 

One fine Spring day a unicorn by the name of 
Gfittcnviugs was born. She was a strong cott and before Cong, 
she was faugh inq and froficking pfaufufXtj with the other 
auimafs of the forest. A feir n»ecks fatcr her mother caffed her 
to speak to ficr . 

"Gftttenriugs. you -^ootiVshaCt team to ffy . " 



Tfits cxrtted (if ittcn rings. She closed her eyes and 
imagined hcrseff soaring graccftdty over treetops and cliffs. 
The vexxj tie\t morning, Glitter itaugs rose carry atid awafcctierf 
her mother. 

"Mother, tnother! Teach tne to fty! 1 iraut to ffq!" 

A (cii! houts fatcr, they reached a stuaff ptatcau 
where the young umroru roufd practice. 

'"".Now, do as 1 say," her mother instructed, "Take a 
deep breath, run as fast as turn can. spread uour nuugs and 
feap." " 

GfittcruMugs did as she tofd. As she iuhakd, her 
eyes narrowed, focusing on the edge of the plateau. She ran at 
top speed^spread her wings. The next thing she remembered 
was being sprairfcd out ott the qrass, and fter mother standing 
oi*cr her. 
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SheLfjctpedJSlItte^^ to her feet. ? 

C^Tio jnot worr y, youtl improve witivyxactiee.^ ^ 

she did* vtffy JfirwUxu she was able to soar a jew yards and 
land/- dio uqh o f t en a&fr fr atvkwardC y . 

At the end of the week Glitterwinys and her mother 
watked to a much steeper and higher ctijj overlooking a soft 
grassy meadow dotted with trees. At the sight of die steep 
drop, Cifitteruunqs froze. She knew she could not ffy ot>cr 
such afffip diff. Even with her mother s demonstration and 
encouragement, she tuoutd not budge. Her mother Uncu* she 
could' not push her, but simply said: 

"Being afraid of new things is naturaf , but you ft 
never succeed unless qou trq." v^-fw cl ^ 

With tcais m fict cues, ttdttcrtinugs rnu(My. Sfic ran 
and rati deep into tfic forest. She had disappointed her mother 
and felt embarrassed about bctnq afraid. Ftnatftyvheu she 
qrciv too tired to rtiti auumotc. she coffapsed in the shefter of a 
maqnofia tree. 

"All the oihct unicorns will make fun of me because 
1- can't ffy," fumcutuf the young umcorn^te-fterscfcf . 

' Wrfl , teff tur now youugu', is it qa l can't ffu or ua' 
irou't ffu?" 

A\ the soutid of the strange voice, (ihttcrnnuas 
tumped up, startled . 

'Who-irh-ii«ho snid that? she raffed. 
Instead of answering, the voice ivcnt on. 
"X sec ya' got iviugs, noiv tvhat seems to be die 

trouble? ' 

(ittttet winqs footed up into the branches of the tree 
to find a pCump bfacfc rather smaff bird foofcmg dotvn 
inqtusitivcty at her. 

Who arc qou?" nsked tfie unicorn. 



"X'm coiled oV Wisefcathers. Who axe you? " 
"I'm of Glitterwings, ami mij wings may gfittcr^mt 
they don't work," she answered. 

"*4h now, wouldja' tike ta' know why?" 

"lies, why? Why don't they work?" Gttttenvtngs 

inquired. 

"That's easy lass, tja' don't believe ya' can!" 

"X don't believe 1 can because X can't!" 

"Weft, that's yer problem. If you don't believe in yer 
dreatns they'd never conic true! But if you have confidence in 
yersetf then ya' can't go tvrong! lust believe me and try it. 
tjou don't think that unicorns can fly if thar a teltin' 
themselves they can't,do ya'?" 

This was beginning to make sense to Glitter wings. 
The more the bird spoke, the more confident the young unicorn 
felt. Her head lifted higher and higher with each sentence that 
escaped die wise beak. She decided to rest in the forest and qo 
home in the morning to tell her^f her new found confidence. ■ — J 
The btrd was stilt asCecp, his beak nested in his feathers when 
she left. 

"Goodbye!" she ivhtspcrcd, "Thank you! 11 



The sun was just peeking over the distant 
mountains tn magnificent golden splendor when she reached 
her home. Her mother had been up all night. 

"Glitter wings, my child where have you been? X 
sfept not a wink because of my worrying!" 

"Oh mother, X met a new friend who told me how 
believing in yourself can help you tnaRc any dream come true! 
X will fly after alii 

Once again they set out for the cliff. When they 
reached it, Gttttcrwings did not freeze, she did not run away, 
instead, she charqed forward with all the confidence tn the 



215 

2JC 



world. She spread her winys and leaped into tfic air . She diet 
not jail. She whinnied with excitement. Other foals who had 
come to practiced watched in awe of Btittcr winy 's qrace. 
Arid as she soared and dipped and rode the wind, she 
remembered the wise bird who had taught her that bctlctn wi 
in yourself is the key which will open the door to any dream. 
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Example #2 (Eighth Grade) 



I HE. Scour 

"^k. Qd&utk , tku) lo £b/oe Fr^rmcu-n. . -Q/rn, a. 
siccu> Ml ■Um i i c r L ^ ^ywett oQsrnc^. uiumpe.d 

ch&rxjL o£ Q3t^ Jprjy on. %zi£haM cixx. 
^eo-L. •^ e * ^CoziacsrnsL cm ctc^ -tcr 

hive {k^a^wW. 
jhn. iite coAL^ hsi uxxt to a atpcj ccjjfei . 

conn. )nCUJ? ^ (jJ0t«£ toxic tiyajp) 7 ^ 

dvjjrdcuTK coA ft? smart hi£ (fiEsKudvjvydfa 



IgzcuLfy^ v j - - . 

a/ til fycd** h& kspL ff-uiit . &z^l JdJr 

fro** dodftf aaW. 

osnd. h bXwjJs rmjL & Qo- tb &^fr/kbruU^o 

^mt d&d hjruw cJuxi tiy vU~ . 
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Uou. ca>>it nave <ucwz lobars. ^jik&iJhio- 
ornxL -p&ii] hcJiii ok &v^ f/iG,*&i6ocr. Qmdffl 
UjkxsX GJxhi QUA &nqou&u(*i£M£* >} (JutrtulL. 

/um IMdLayolj) ttr tku*k atotJ.it!' 

tc W M &uhtfdlS) y^QJ fawny /LOW jkx 



Qyich* cucld qjk otd rrruxrK. a/ <$9, ^6/^, 6jao /a 

^VhjucK KYiacVKb rrruruz. ttr/^l' 
c< & (^ab&ji^icDh^, Yl&ct b&M^ <^odk^ CHxt £ol hjXr 




0 - CdcujMTi^ act tke cL$k_ , 3hsyu bo^L 

-fay Leg . ° Fnsarmjajh_ hojihscL . " 
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^sisrAX. ? uxxlUcL Amytal fydtjv&rtd (jjofrd. 

u 7tbi 
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6: Elaborated Story, Few papers were considered to be Elaborated Stories. 
To be classified as elaborated, these stories had to present a sequence of 
episodes in which almost all of the events and story elements were well 
developed. Goals or problems introduced in the beginning were well 
resolved by the end; characters' motives were well developed; and the 
entire story was cohesive and unified. 



It was the fourth evenlna of Henrys hunting trip. Henry brisklv 
walked back to his campsite, he laid down the rifle he was carrying and 
climbed Into a soft, warm sleeping bag. Within a minute he was sound 
asleep. 

In the morning Henry woke up freezing because because during the 
night a blizzard had arisen. He gathered his belongings and began his 
long walk out of the forest. The wind screamed and howled like a maaman. 
Furiously, it slapped his face. Within ten minutes Henrv was coid. wet 
and tired. He was not sure If he was neaded in the right direction 
because was a white Dlur of snow In front of him. He was havino aouots 
if he would ever make it to the ena of the forest. 

With a heavy Dag on his shoulders, he fought the wind ana snow witr. 
ail his mlgnt. like a raging bull trying to defeat the matlaor. He was 
wlshlno he could De safe at home slttlno In his armchair, with a fire in 
tne fireplace ana his golaen retriever at his feet Instead of being stuck 
In a Dllzzara. His eyes felt like they were weighted down witn heavy 
bars of Iron. He wanted to lie down In the snow and give ud. but he kept 
telling himself that he had to continue. 

After an hour. Henry's bones felt like they were about to collapse 
and he was hungry, thoroughly numb and frostbitten. In the distance he 
could hear the the cars on the highway hum. so he trudged on. His bones 
were as stiff as stlcKs. ana it was hard for him to continue. His Drain 



Tne Bl Izzara 
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kept telling him that he had to continue, but his muscles told him to lie 
down In the snow, 

Henry kept on walking in the direction of where he thought the 
highway was, but he soon realized that he had been walking In the wrong 
direction. He could not hear the highway anymore and he had lost all 
hope of ever getting out of the forest. He could not walk anymore so he 
collapsed onto a soft, white blanket. He closed his eyes and fell asleep 
In a bed of snow, 

Henry old not realize that there was a cottage hidden by the trees, 
only a few feet away. The old man who lived in this cottage had seen him 
fall In the snow so ne had put on his long, grey overcoat and stumbled 
out of his nouse into the blizzard. He took a few steps toward the 
snow-coverea body." then tumbled Into the snow. He managed to get ud 
again and stumble towards Henry, He slowlv Inched Henry's body towards 
his house. Finally, the old man reached his front door, dragging Henry 
behind him. The ola man rolea Henrys cold body towards the fireplace. 
He felt Henry's pulse. There was still a faint beet. The old man sat 
back in his rocker and stared at Henry for over an hour, seeing if he 
would blink an eye or wiggle a finger. Just as the man was about to fail 
asleep. Henry uttered a few words. "Excuse me sir. where am I?" 
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2. Informative Writing 

The following examples illustrate the range of informative writing 
submitted by the students who participated in this study. The students' 
papers are arranged according to the scores they received when they were 
evaluated. Each set of samples is preceded by an explanation of how these 
papers fit into the corresponding category. 

1: Listing. The two papers below are examples of Listings. The writers 
present pieces of information or ideas all on the same topic. These papers 
may also contain a range of information about the topics. However, no 
attempt is made to relate the ideas or information. 



Example #1 (Fourth Grade) 



ivs^mJj-u^^fl^ ^tr,_cc CLoJAcl tikfri* ^) Cap<0/^d 
<goU, lc3 i.a.gK.t. .^£Ao-o(«<J) L^u^ JkoJ- 
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Example #2 (Fourth Grade) 
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2: Attempted Discussion. The two papers below arc examples of 
Attempted Discussions. A range of information and/or ideas about a topic is 
presented in these papers. Also, in one part of each paper, some attempt is 
made to establish relationships between the pieces of information or ideas. 
However, these relationships are not clearly established. The ideas or 
information may be incomplete or undeveloped. 



Example #1 (Fourth Grade) 



l$50-~ /9.5.J 4^--— K ^ Lt *— 



.sLiy~VLSi 

1Ad \frv\jkju,L fiXat**,. 




JL^ ^ //i^.-X^ocJ^ti^ t/r^ — Afi — r^Xc/ ^>teJujLc< 
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Example #2 (Fourth Grade) 
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3: Undeveloped Discussion. The two papers below are examples of 
Undeveloped Discussions. These papers include a broad range of information 
about their topics. Relationships are somewhat established between the 
ideas and /or information, but not completely. The ideas may be confused, 
contradictory, out of sequence, illogical, or undeveloped. 

Example #1 (Eighth Grade) 



Bac& Ynv ta_uYi1r, aod. 
.pacer ,a,pcaot- perxa ,a ^6\a\s> .... 
_a_mj;^^jnix£caij_c*i_ 

xemie. r>a-£L.-piQ2e._oe . mper.. . ..... 

.M t fttL_aair_papa'' and pjor 

and wer rxunc ,adate3s» / and 2.1'P 
aflc iD-±iU-u4)p£A-i(ft coto" - 

.oeccr..paT. tr£ .persons 



Tl( :T 



..aid lasLoanu. , axttress , 

ara . zip cede . Mojo, put jJvl 
iMp... u^cl- hi .upper rtflftt . ... 

^10lJ.u..lVu^_.,.0iaJ. Tl .it .wi^CiO^ 

-pjQGi- put xt -uo aoar maun 

POX v J 
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Example #2 (Fourth Grade) 




JOHN PAUL J 



John Paul tuas born on July 6, 1747 
in Scotland and loved to ujatch the 
ships go by his cottage. When John 
ujas 13 he ujent to sea on Friendship. 
In 1764 he u_« as dismissed from the 
Friendship. 3ut he ujasn't out for long. 
Soon he got tiuo more Jobs before he 
uas captain of his oujn ship! But then 
something happened. John's 
ship ujas at anchor in the West Indies 
ujhen one of the creuj tried to start 
a mutiny. The sailor rushed at John, 
sujinging a heavy club. John fought 
back ujith his sujord and killed the 
mutineer. In revenge, the dead man's 
friends threatened to murder the 
captain and burn the ship. John 
wanted to stand his ground, but he 
ujas advised to leave quickly. Then he 
ujent to Virginia and Joined the 
flmerian navy. Then in 1779, he 
fought in the Revolutionary War 



against Great 8 r i t i a n . 
later, he died. For 
113 years, his body 
lay in a r>rnoll 
French ctaim* lary • 
Then, in 1'JO!., !m> 
uj Zi !: f n • n m t • ! ! ! '. i < 
Uni «1 Si j i i> • . . I 

J • . . i • : ) 1 1 ! J ... i . , • ■ 1 i • • 



Thirteen years 
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4: Discussion. The two papers below are examples of Discussions. In these 
papers, a broad range of information and/or ideas is presented. In at least 
one section, the writers use rhetorical devices (such as temporal order, 
classification, definition, comparison/contrast, cause and effect, problem/ 
solution, goals/resolutions, predictions, speculations, drawing conclusions, 
point of view, ranking by importance, exemplification) to clearly relate the 
information and ideas. 



THE HYDROGEN BOMBS GET THEIR ENERGY FROM THE FUSION OF 
ijYDROGEN ATOMS. SUN AND STARS PRODUCE HYDROGEN ATOMS. 

-^HYDROGEN ATOMS REACH FIFTEEN MILLION DEGREES CELSIUS. AN 
ATOM BOMB EXPLODES ACTING AS A TRIGGER. IT TRIGGERS THE 
FUSION OF THE HYDROGEN ATOMS WHICH CAUSES A MASSIVE 
DESTRUCTIVE FORCE. THERE ARE TWO MAIN HYDROGEN ISOTOPES - 
DEUTERIUM AND JffilMtiiV AN ARTIFICIALLY MADE RADIOACTIVE 
ISOTOPE. m 

THE" STEPS TO THE EXPLOSION IS THE ATOM BOMB ACTS AS A 
TRIGGER WHEN IT EXPLODES, THIS CAUSES THE HEAT AND PRESSURE 
FOR THE FUSION OF THE TWO HEAVY ISOTOPES. WHEN THIS HAPPENS 
THE HYDROGEN BOMB RAPIDLY RELEASES ENORMOUS AMOUNTS OF 
ENERGY THAT CAUSES A TREMENDOUS HIGH ENERGY EXPLOSION. THIS 
IS CALLED FISSION. -^THE FISSION PRODUCED LARGE AMOUNTS OF 
FISSION PRODUCTS, WHICH FALL TO EARTH AS DAMAGING FALL- 
OUT. THESE ARE THE EFFECTS OF THE HYDROGEN BOMB EXPLOSION. 
THE HYDROGEN BOMB PRODUCES AN ENORMOUS FIREBALL THAT WIPES 
OUT EVERYTHING IN ITS PATH. THIS FIREBALL EQUALS THREE AND A 
HALF MILES LONG DEPENDING ON THE SIZE OF THE BOMB OR THE 
WARHEAD. NEXT THE FIREBALL SPREADS OUT FURTHER .OTt^ MAKES A 
SMOKEBALL WITH A HANDLE COMING FROM THE BOTTOM. FINALLY IT 
TURNS INTO A MUSHROOM CLOUD. 



Example #1 (Fourth Grade) 





v. 



Example #2 (Eighth Grade) 
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5: Developed Discussion. The two papers below are examples of 
Developed Discussions. These papers include a broad range of information. 
Information and relationships are established and well developed, with 
explanations and supporting details. The paragraphs tend to be unified 
and well formed. However, the paper lacks an overriding sense of purpose, 
audience, and cohesion. The writers of these papers present a wide range of 
information on a topic, organize this information clearly, develop most of 
the aspects of this topic, yet do not place their discussion in context, within 
a wider communicative purpose. 



Example #1 (Eighth Grade) 



building =t strong Cl'ir-ractsr 

Building a "atroivj character' 1 could be det ined as 
watching an:l attempting to do everything that could make you 
a disciplined and respectable persun . Many people in our 
society 1 oof up to others who are either responsiole, 
genial , or talented. A major 1 ty c t- people respect others 
who are euner t-amous tor their talents, 1 ike riicheal J. 
Fo:; : or well known tor their reliability, like some leaders 
o I our conn r.rv . 1 n order to build a s t ran g c n ar ac z sr t or 
yourself, you must r irst practice vour d 1 = c 1 1: 1 marv 
abilities to be rel 1 ao 1 e , respectt-ul, and honest. 

When you *re reliable, people trust your judgement ana 
vour abilities to accomplish things successfully. When you 
want to be accepted into a well-known university, tne 
advisors at that university usually scrutinize your 
scholarship grades. They also examine your reliability and 
directness in school clubs and organizations. It you are 
proven to be very reliable and accomplished in these 
subjects, you will most likely be accepted into an ivy 
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I eague university, and be successful in li-fe. Being very 
reliable, enriches your abilities to accomol ish tasks, and 
allow* you to take one step into having a disciplined 
character . 

Another way to strengthen you character is to respect 

the thoughts and ideas o-f others. It you are patient and 

tolerant of others they will be patient with you. By 

respecting someone 9 the person you are patient will most 
orten take the time to listen to your ideas and suggestions. 

It vou have accepted a job and you prove to your boss that 

you are respectful , your boss would most likely think or vou 

as an honorabl e . A person who takes time ana respects 

others has obtainea an assential part ot maintaining a 

strong character . 

An important part of havi ng a strong character is to be 

honest and don't try to hide your* mistakes or misjudgements 

in your life. You shoul a admitt to your mistakes and be 

honest about the real intentions of your actions. If vou do 

this, the people who believe in your judgements and 

interpretations will be on your side for the right re*:- on a 

and not for what they believe are the right reasons. &eing 

honest strengthens character oy making people apprise 1 ate 

you for who you are. 
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Example #2 (Eighth Grade) 




"The Puerto Rican Hot Dog" 



"If I own^d a big league club I'd order everybody off 
the field and put Roberto Clemente in the outfield all by 
himself in fielding practice, and let him throw the ball. 
(h)>w can he throw" (Hano 9)! Yin Scully made this quote to 
describe that Roberto was such a good fielder. Also, he was 
a great humanitarian who died in 1972 bringing relief 
supplies to Nicaragua. Was Roberto Clemente Ulfi greatest, 
r i glit fielder of all t ime? 

Roberto Walker Clemente was born August IS, 1934, in 
Carolina, Puerto Rico. He was called "Moraen", a made up 
word, by his family. Roberto's father was Don Melchor 
Clemente, and mother Dona Luisa Clemen I c . Don was a foreman 
on a sugar plantation making $4 an hour. Also I litr family ran 



a sroeerv store and meat market. Roberto had two jobs as a 



A 



child, loading and unloading his fathers trucks and ^ 
delivering milk. He saved for 3 years to buy a bicycle. His 
hero was Monte Irvin of the New York Giants. Roberto played 
baseball in the streets all of the t irae, and was frequent ly 
late for dinner. One time that Roberto was late for dinner 



his mother tried to burn his bat in the f i replace . * ^ 



A 
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Roberto had an interesting High School career at Julio 
Vizcarrando High School. He was a good student and an all 
star athlete. Roberto's accompl ishmonts included: Javelin 
throwing, high Jump, and triple Jump, Roberto wa3 signed by 
the Santurce Crabbers, a Puerto Rican League team. He was 
given a $500 signing bonus, a $60-a-month salary, and a new 
glove. Other Major League Baseball players who were on the 
team were Willie Mays, Orlando Cepeda, Ruben Gomez, and t 
Herman Franks. AVW-'v 

y- jK^V* 

7 >% 1953 Roberto had his first experience with Major League 
scouts. In 1953 Roberto was noticed by Brooklyn Dodger scout 
Al Campanis. When Roberto finished High School he was signed 
by the Dodgers with a $10,000 bonus and a $5, 000-a -year 
salary. He was offered a $28,000 bonus from the Milwaukee 
Braves, but didn't accept it. 

The Montreal Royals were Roberto's first real test to 
see if he was Major League material. In 1954, Roberto played 
for the Montreal Royals of the International League. He 
wasn't playing very much and got frustrated. M In one game, 
he hit three triples. The next day, he was sitting on the 
bench. If he struck out, he stayed in the game. If he got a 
hit, he was certain to be replaced" < Wa 1 ker '38 ) . Roberto's 
manager wanted him to stay hidden because any player with a 
bonus over $4,000 had lo be on the Major League roster. The 
Dodgers had a great outfield: Jackie Robinson in left, Duke 
Snider in center, and Carl Furillo in right. So there was no 
room for Rober t o . 
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Roberto was drafted by the Pirates in 1954. He had been 
noticed by Clyde Sukeforth of the Pittsburg Pirates while 
playing with the Royals* Clyde knew that Roberto was a bonus 
baby, a player that had a bonus of over $4,000 and wasn ! t on 
the Major League roster. Also, Clyde knew that the Pirates 
would finish last, so they would get the first pick in the 
draft. On November 22, 1954 Roberto Clemente was the #1 
Draft choice over all by the Pittsburg Pirates. Roberto 
didn't know where Pittsburg was, but signed for $4,000. 

In his rookie season, Roberto faced many challenges 
including a bad back. Roberto's first MLB at bat was Sunday 
April 17, 1955 against Johnny Podres of the Broklyn Dodgers, 
when he made an infield hit. Roberto hit his first home run 
against the New York Giants April IS, 1955. He hurt his back 
in an accident with a drunk driver and had to sit out many 
games of his rookie season. 

The years 1960 and 1961 were good ones for the Pirates 
and Roberto. In 1960, Roberto was selected as a reserve on 
the All-Star team. The Pirates won the National League 
Pennant and played the New York Yankees. In game seven, in 
the bottom of the ninth with the score tied 9-9, Bill 
Mazeroski was at the plate versus Ralph Terry. He hit a deep 
drive to left field. Yogi Berra could only watch the ball 
sail over the fence for a home run. The Pirates had won the 
World Series! In 1961, Roberto started the All-Star game and 
played the whole game. He also led the MLB In hitting that 
year with a .351 Batting Average. 
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In 1968, Roberto had a bad year and thought about 
retiring. He hurt his right shoulder making a diving catch. 
That year Roberto hit only .291, his first year under .300 
since 1959. In 1969, he injured his left shoulder. Also, 
Roberto was picked up by four men and who thought about 
killing him but when they found out that he was Rober t o 
Clemente, they left him. 

The year 1970 was near the end of Roberto's career and 
the end of Forbes Field. On June 2S, 1970 the Pirates played 
the last game at Forbes Field. On July 24, 1970 they 
celebrated Roberto Clemente Night, his family and friends 
came and he made a speech. It was a joyous night for all of 
Puer to Rico. The Pirates won the National League East, but 
lost to the Cincinnat i Reds in the Nat ional League 
Charapi onshl p Ser i es . 

In 1971, the Pirates went to the World Series for the 
second time. Tho Pirates won the National League Pennant and 
went on to meet the Baltimore Orioles in the World Series. 
The Pirates lost the first two games and returned to 
Pittsburg for Game 3. Game 3 was the first night game in 
World Series history. The Pirates won three games and the 
Orioles won one, more so the stage was set for Game 7 in 
Baltimore. The Pirates won Game 7, 2-1, and the Pirates were 
t he Wor Id Champ i ons ! Rober t o was named MVP of t he Ser i es 
because he hit .414. 
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Rober t o • s last season in basebal 1 was 1972. He got his 
3,000Lh. hit September 30, 1972 off Jon Matlock of the New 



York Mets. It was a double, and after he hit it they called 
time out and awarded the base to Roberto. It was one of the 
happiest days off his life, Ho was the HJJl player to get 
3,000 hits. The Pirates won the National League East but 
lost in the League Championship Ser i es £j*ober t o died in a 
plane crash December 31, 1972, flying earthquake relief 
supplies to Nicaragua. His father and son Roberto Jr. both 



In 1973, Roberto was elected to the Hall of Fame in a 
special vote. His number, 21, was also retired. Roberto led 



the Pirates in career: games ^ay^d, hits, and total bases. 

He was third in runs scored, RBI's, doubles, triples, and 
home runs. Roberto won 4 Silver Bats, leading the league in 
hits, one MVP, one MVP of World Series, 12 Gold Gloves, 
given to best fielder in each league for each position, and 
he was an All-Star 14 times. His lifetime Batting Average 
was .317 and finished with 1,305 RBI's. 
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Roberto Clemente. was an Immigrant from PUCTt 0. RlCQi. 
and iifi. contributed L2. LtUL Held fci fcajuikull <LA ft. gliULg-T. » 
Clemente played for 18 years with the Pirates from 
1955-1972. He was National League MVP In 1988 and World 
Series MVP 1971. Roberto died a sad and sudden death in 
1972. I think Roberto Clemente wa** a good person and also a 
very good baseball player as is evident by his work with 
charities and his MVP trophies.,: r 

Ke y; 

Lea . -League 

Int . -Inter nat ional League 
Nat . -Nat i ona 1 League 
G-Games Played 
AB-At Bats 
R-Runs 
H-Hi is 
2B-Doubles 
3B-Tr iples 
HR-Home Runs 
RBI-Runs Batted In 
SO-Strike Outs 
BB-Base On Balls(Walks) 
SB-Stolen Bases 
BA-Batt ing Average 
SA-Slugging Pecentage 
(Walker 136) (Cooperstown 278 )" 
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Regular S eason 



Year 


Lea . 


G 


AB 


R 


H 


2P 


3P 


HR 


RBI 


SO 


PB 




13A . 


C* A 


1954 


Int . 


87 


148 


27 


38 






2 


12 








,257 




1955 


Nat . 


124 


474 


48 


121 


23 


1 1 


5 


A *7 

4 7 




t 8 


i« 


A r r 

, 2 n r> 


. 3 8 2 


1956 


Nat . 


4 A 1 
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C A O 

543 


66 


169 


30 


7 

7 


7 


b 0 


c o 
D 0 


4 >1 
1 J 


ii 
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.311 


A ' i 4 


4 A C f 

19 57 


M«. 4- 

Nat . 


4 4 4 
111 


4 5 1 


A A 

4a; 


4 4/1 
114 


1 1 


7 


A 

4 


'J A 


4 li 


A. J 


A 

u 


O P. 1 
. A, U li 




4 Q C O 

i y 58 


Nat . 


14U 


C 4 A 

519 


o y 


4 C A 


Z 4 


1 A 

1 u 


c 
o 


ri a 


.4 1 

4 1 


J 1 


Q 
O 


A O O 


A A O 

. 4 U o 


4 A c Q 

l y d y 


Nat . 


4 A C 

1U& 


A A O 
4 4. J 


o. a 
b U 


4 O C 
1 £ O 


4 7 

1 7 


7 
1 


4 

4 


r A 


r < 
U 1 


1 u 


n 
a> 


. Z J b 


«J Q f> 

. jyb 


4 A A /\ 

1960 


Nat . 


144 


C 7 A 

57 0 


8 9 


17 9 


A O 


A 

b 


4 P 

1 b 


A 4 

9 4 


7 A 

7 J 


r > A 

3 u 


4 


O 4 A 

.314 


. 458 


4 A A 4 

1961 


Nat . 


4 <4 A 

14 6 


C 7 A 

5 7 a; 


« a a 

100 


201 


n A 

30 


4 A 

1 0 


A •) 

Z 3 


O A 

8 9 


C A 


3 r> 


4 


n c 4 

.351 


CCA 


1962 


XI ~ *- 

Nat . 


4 A A 

144 


538 


n c 
9 0 


168 


A O 

I 8 


A 

y 


4 A 

1 0 


ff A 

7 1 


7 7 

7 3 


r > c 
3 o 


A 

b 


O 4 A 

. 3 1 i! 


. 4o4 


4 a a o 

1 9 6 3 


Xf ... A. 

Nat . 


4 C A 

15 a; 


AAA 

600 


7 *T 

7 7 


i A A 

19 2 


o 7 


o 

a 


4 7 

1 7 


7 b 


/4 

b 4 


'> 4 

3 1 


4 O 
1 Z 


O O A 

. 3 *. U 


v! 7 A 
. 4 i U 


4 A A /4 

1964 


Nat . 


4 C C 

15 5 


a o n 

6 2^ 


n c 

y 5 


A 4 4 
A? 1 1 


.4 A 

4 0 


7 

7 


4 A 
1 Z 


O "7 

o f 


O 7 

o 7 


C 4 

5 1 


e 


O O A 

. 33y 


.48 4 


4 a £ e 

196 5 


Na t . 


4 C A 

1 5 Z 


Hon 

58 9 


Ci 4 

y l 


4 A y4 

i y 4 


A 4 
Z 1 


4 A 

1 4 


4 A 
1 0 


A £t 

6 5 


7 O 

7 o 


4 3 
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o 
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. 3 *; y 


. 4 b 3 


1966 


XI ~ *- 

Nat . 


4 C A 

15 4 


6 38 


105 


2 02 


A 4 

3 1 


4 A 

1 1 


A A 

2 J 


4 4 A 

119 


4 A A 

109 


A A 

4 b 


7 

7 


O 4 7 

.317 


c o ^ 

. 5 3b 


4 A A T 

196 7 


XI « *- 

Nat . 


147 


c ft c 

58 5 


4 A O 

103 


AAA 

a! 0 9 


A O 

£ b 


1 U 


£ 3 


4 4 A 

110 


4 A »5 
10 3 


<t 4 

4 1 


y 


O C 7 

. 3&7 


C C A 

. 554 
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Nat . 
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502 


7 4 


146 


18 


12 


18 


57 


77 


51 


n 

<b 


. 291 


. 482 


1969 


Nat . 


133 


507 


S7 


175 


20 


12 


19 


91 


73 


56 


4 


.345 


.544 


1970 


Nat . 


10S 


412 


65 


145 


22 


10 


14 


60 


66 


38 


3 


. 352 


.556 


1971 


Nat . 


132 


522 


82 


178 


29 


S 


13 


86 


65 


26 


1 


. 341 


.502 


1972 


Nat . 


102 


378 


68 


118 


19 


7 


10 


60 


49 


29 


0 


. 312 


. 479 



Totals v^ ' 

J- 

G AB R H 2B 3B HR RBI SO BB SB BA SA 



2433 9454 1416 3000 440 166 240 1305 1230 621 S3 .317 .475 
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League Championship ^Up^ /Serie s 
year Lea. G AB R H 2B 3B HR RBI SO BB SB BA SA 



1970 


Nat . 


3 


14 


1 


3 


0 


0 


0 


1 


4 


0 


0 


.214 


1971 


Nat . 


4 


18 


2 


6 


0 


0 


0 


4 


6 


1 


0 


.333 


1972 


Nat . 


5 


17 


1 


4 


1 


0 


1 


2 


5 


3 


0 


. 235 



Totals 

G AB R H 2B 3B HR RBI SO BB SB BA SA 

12 49 4 13 1 0 1 7 15 4 0 .265 .347 

Wor Id Ser les 

Yea r Lea. G AB R H 2B 3B HR RBI SO BB SB BA SA 

1060 Nat. 7 29 1 9 0003 4 00 .310 .310 
1971 Nat. 7 29 3 12 2 12 4 2 2 0 .414, .759 

T..I a Is 

. «. A13 \ \ H 2B 3B HR RBI SO BB SB BA SA 

14 (IN 4 21 2 12 7 6 2 0 .362 .534 
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B 1 b 1 i o^raphy 



Basebal 1 | a Ha 1 1 o f Fame : Cooperst own. New York, Arlington 

House, Inc., 1988, pp. 47-48, 278. 
50 Amer lean B 1 Pgr aph 1 es f Orlando, Harcourt Brace Jovanovlch 

Inc., 1989, pp. 278-284. 
Hano, Arnold. Rober to CI ement e . New York, Putnam's Sons, 



Peary, Danny, ed . Cult Basebal 1 Players . New York, Simon k 

Schuster Inc., 1990, pp. 294-300. 
Walker Paul Robert. Pr Ide of Puer t o Rico, Orlando, Harcourt 

Brace Jovanovlch Inc., 19S8. 



1968 . 
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(>: Elaborated Discussion. Virtually no papers were considered to be 
/ Itifomited Discussion*. For papers to be placed in this category, they had to 
i on tci in all the elements of the previous category, plus present a coherent 
st ns«» ol purpose and audience. These papers would contain an overt use 
ol organizational structure and demonstrate excellent command of the 
mm lotions of written English. 
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3. Persuasive Writing 

The following examples illustrate the range of persuasive writing submitted 
by the students who participated in this study. The students' papers are 
arranged according to the scores they received when they were evaluated. 
Each set of samples is preceded by an explanation of how these papers tit 
into the corresponding category. 

1: Opinion. The two papers below are examples of Opinion*. At this level 
the writer asserts an opinion, but does not develop or explain this opinion 
in any detail. In Opinion papers reasons sometimes are given to support 
the opinion (as in the first example), but these reasons are unrelated to the 
opinion, contradict each other, or are confusing. In the second example, the 
writing itself is so unclear that the reasons for the opinion ('i think people 
should stop cutting down trees") are difficult to understand. 



Example #1 (Eighth Grade) 
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Example #2 (Fourth Grade) 



pdt l-«t t As- pa*** < 
<ewi \J xn/A'j> ptefit d/vt'^d lube- 

fc^yif , M&y tow Mmm* 

I / A I . . // 



lot , 



1 



A tiff it ^ 
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2: Extended Opinion* The two papers below are examples of Extended 
Opinions, These papers include a statement of opinion and reasons to 
support the opinion. However, the reasons are only briefly presented or 
ihe explanations are confusing. 



Example #1 (Eighth Grade) 



0 recto V5 \6Ma 




( ^fcoa , tKi^ cjOnuflb. set- Cjmm-.. 
QCto Gdd J &i&t co /?r?i^A <^w> 
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Example #2 (Eighth Grade) 



I think burning the American Flag is the wrong thing to 
do because they are burning something that belongs to the 
country. 

Some people burn flags at a ceremony, then bury the ashes. 
I think all of that .is wrong. I think we should build a big 
huge building that we can store American Flags in after they 
are worn ou* or no longer useful. When the building gets. full 
we should take all of the flags inside the building and bury 
all of them without burning them first. After burying them, 
we should do the same thing again and again. 

Some people just burn a flag because it is warn out or 
they hate the country. 

My grandfather is with the Knights of Columbus and they 
burn the flags then bury the ashes. I asked him if he thought 
my idea was a good idea and he does not like burning the flags, 
even though it is at a ceremony. 

People that burn flags because they do not like our country, 
even though they live in this country, they should be thrown 
out of this country and sent to another one. 

When I get older, I will try to build the building I was 
was talking about earlier. If my plan does not succeed, I will 
just try to get Americans to bury the American Flags without 
burning them. 

Another way to expose the used American Flags is to bury 
them with a person who has served in the Armed Forces, and 
has died that way the flag will decentigrate with the Armed 
Forces member that it is buried with. 

When I asked my mother if she thought it was right to burn 
the American Flag, she agreed with me and also said that 
someone should do something about it. 

When I asked my father about the burning of the American 
Flags, he also said I was right to be against burning the 
American Flags. 

The last person I asked^was my grandmother. She says that- 
the president should build a building to hold all of the used 
American Flags, even the new ones. 

Protestors who burn the flags show no respect for their 
country. Even though they have the freedom to burn a flag, 
the flag represents the country that gives them that freedom. 

A flag burning ceremony is sad any time I see a flag being 
burned, it reminds me of some kind of destruction. When I see 
a flag being burned, the stars being separated reminds me of 
the fifty states being separated. 

When people see American Flags being burned, they see tiny 
parts of the flag float off into the air and know that all 
the ashes will not be buried together. 

That is the end of my saying about the burning of the 
American Flag. I hope people agree that the burning of the 
American Flag is wrong. 
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3: Elaborated Opinion. The two papers below are examples of Elaborated 
Opinions. These papers include an opinion statement and clear reasons to 
support the opinion. They also contain attempts to develop the opinion with 
further explanation. However, the explanations given are not developed or 
elaborated. These papers may also contain an implicit reference to the 
opposing point of view. 



Example #1 (Eighth Grade) 




V 
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Example #2 (Eighth Grade) 






rn&) u&lvuthL Qlxoio dkii 

JMtuu tforobk d&piA *xk . 

M)ih) iwtwi a/p Jul diud 

ryuy amp chiv Jjwl iMmlm 1 
...jj t& cJak jjt mxw cMfu 

am anxL iMYijmL tffarL foM elk 
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4: Argument. The two papers below are examples of Arguments. In these 
papers, the writers state their opinions and give reasons to support their 
opinions. They also include at least one explanation that is well developed. 
Rhetorical devices (such as sequence of events, comparison/contrast, 
problem/solution, and classification) may be used to develop the 
explanation. These papers may also contain a brief summary of the 
opposite point of view. 



From my point of view, I feel there shouldn't be a 
longer school year because the government would have to come 
up with more money, because children are going to need a 
summer to relax, and teachers are not allowed enough time to 
teach* 



First, the government would have to come up with more 
money. For instance, the government would have to come up 
with money for air conditioning because without cool air the 
children are going to feel uncomfortable and they're not 
going to be able to concentrate on their studies. If they do 
not get air condit ioning v they' re going to have to buy 
fans, They're going to have to come up with money to pay 
their teachers for working more days because they won't work 
for free, They' re qom>a need more money to keep the school 
open and more money for keeping the lights on. 



Example #1 (Eighth Grade) 



WE DON' T NEED A LONGER SCHOOL YEAR ! ! ! 
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Secondly, the children are going to need a Summer to 

. Vo 

relax. Children are not 9000a be able to concentrate on their 
studies while other children are outside playing or at 
camp. All children are not going to do well on their homework 
or on tests while they're thinking about swimming or playing 
outside. 

Third, from an article that I found in JUNIOR 
SCHOLASTIC a teacher says. "The problem is that teachers are 
not allowed enough time to teach. "Carrol 1 says, " Teachers 
need to be allowed to make better use of their time. Rather 
than monitor study halls or do administrative paper 
work, teacher s should spend more time in class with kids." 

As one can see from the reason^ above, I do not feel 
that there should be a longer school year.? 



250 




Example #2 (Eighth Grade) 



There. \s ao doubV. _thOct_jV ujoulo 
make sSVudcn-ts . Appier to. Jncuot .. .rwofc 
Stuiin^r Cu un (u I a ft. r>c£S . ui.Ma . bcH~e f 
o\'5d lackeys j COrvVeSr^s <S-nJ 
Of, a »Y*0A •VW.yyvjUi. .. 

Wter d\5c v'ocke^ .wooAA fCSAAA-. in 

Urufr cvouM S-hjcitrrts- Since 

'»\£ nYst disc jockey _£i<*y£<L 
inappropriate music. uoe AoV ouf 

\y\2b\ svu c\ e n Vs . Qfec^J^ . . d.is U'V^e .. 

TWu5 results \a .V^vj\.03 . P^££^- 

/"~ / ObviouSW) \^ 'we. ta^ye_ _ x ottte<c 

a*SC r c ^ S , \ V ojflo \ 6 . .. res-. ^ \ n 
\ St'udc/i't' oountil (j^nce 

t„VO'> COffCS^- CO-V". result" in 
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CouAOl dollar eo,c^ 

WVco-d ^ hcvvvfv^ V>£>r\nc^ "^tmifc. 

AlSo, you uW<LA'+- K^ve -to dfCJpe 

V:Oti (X reaulM ty\i<W . 'Then >/pv 
couU iccairtLW iW ok nets o^ioGfc!^ 
it) Ata ■Magjyvl. 

■( i<xr>ee wjoo\d better also. 

v v l ^ "fta* S \v i t\ ■ p f o baJcA ^ too u I o v : - 
n v \u bo 4 h-crcd Vkj p&.fnc*, r>v>c t 

i <- r m <l 'o-<' a e C v +■ S Hid or^ 
0K>def\+ coundvi 4a-rc.cS. TW 
better ''^^^co^^sH^ «-r\A 

r^o<<i -Par YVm's o^p Or +u r> \ V- ^ . 
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5: Developed Argument. The two papers below are examples of Developed 
Arguments. These papers support their opinions with clearly developed 
explanations. They also show an awareness of audience through the use of 
voice and/or the selection of appropriate supporting details. 



Example #1 (Eighth Grade) 



..Arrm 
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*- JiM-fi ^Am p lm^ . . 

-^OCU^ 
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Example #2 (Eighth Grade) 

j /C'jiax> ^p,uncXpcU : ...... 

j. . U CVrpJ CL .AtiLCU-^lt dCrU/7? 

! 

./QArHhtPTK' uTu QUA) .j6(LhO&4.. 
JLV61U? J-'lOLDltuytrrnj-jJri' -JJxau.. . 



^clUj .U'/vru <iiuu LjCtCd J^j. 
to ^k/nSrto. aJbcujb .... . 

, . ^Qixrrd . . 
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\JXLLtt . _CL...oLa/rui . . QJr.-JJU.. Mrtd— 

I 

I __ ___ . ... , 



. lulU J&hoiu ..Lip. > - .CtZiti-COtyJjb . 








~~( , 






( 







Otf A&IlcLlCTsU) UJL& 

\o-tl^-Uu2 ..lotted Cty^l 
! 

\ " ° 
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6: Elaborated Argument The paper below is an example of an Elaborated 
Argument. The few papers rated at this level present well-developed 
explanations in support of their opinions. Also, their presentation of details 
is clear and appropriate for the intended audience. 



Example #1 (Eighth Grade) 

j 
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JuaaoI y ^ c ^ su^Jj? <U&&~ ^x2^£#rL 

'bi^nd^y ~&icCt d/uLy (l&rrxL- /t^u>y C^t> , 

AfUj ({t^cAnt ^\^f^- ^j^A- ,A£&^ ^zXcK^i&t 

Die 
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Q^VJ^^J^^ / ^L&tt^l_ yZXjJUj Cl/styX^ 

Tttvv^ ^LjdtferA. U^'^tk^L^ /6ukX^^^ ^dfr 
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4. Poems 

The following examples illustrate the poems that were submitted. 

Example #1 (Fourth Grade) 




Write the following in correct 
haiku form. Begin each line with 
an upper-case letter. 

The day is dying black clouds cre ep ove r 
the sun many lights are~out. 



JO i) h 



a / 



Write a haiku of your own. 
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Example #2 (Eighth Grade) 



Spring Breeze 
Gently blowing soft 
Pleasantly flowing longer 
Kissing the child's cheeks. 
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Example #3 (Eighth Grade) 



(l 0 <v\ 



I 



c i r h 



.J 



2()4 
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Example #4 (Eighth Grade) 



WHAT ARE THE LESSONS OF THE HOLOCAUST 
FOR AMERICA? 



The croup who suffered, 

better known as Jews , 

were stripped of their clothing, 

Jewel r y , and shoes , 

Some were killed, 

their bodies char/ed. 

The others put to work, 

then teased and scarred. 

Fr on all this 

we should know 

with a prejudice heart 

you can not grow. 

Yet still some people 

think t he same way, 

that all people aren't equal, 

and that's not true today. 

They are the ones to blame 

for doing horrible things, 

like supporting the Holocaust 

and causing the ordeal of Rodney King. 

These oppressors need to realize 
that what they think and do, 
is wrong in the eyes of God, 
and hurts people like me and you. 

One thing we forget Is our real best friend 
who'll stay close beside us until the very end. 
Jesus is his name and he loves us all. 
When people realize this, we stand and never fall. 

So keep your spirits up and never lose your faith 
and try to help others no matter what their race. 
Tell People who think prejudice Is fine 

to get that out of their heads and to try to clear their minds* 

The Holocaust was terrible, 
and it could happen again. 
That's why we should all learn 
racism is very wrong. 

It pollutes our hearts and weakens the strong. 

Jesus said he'd be back, 

but he didn't say when or where. 

When he returns If we want to go, 

we must stand as one and say, 

end d I s cr I ml no t Ion! 

Not tomorrow but today! 
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5. Letters 



The following examples illustrate the letters that were submitted, but could 
not be classified as informative or persuasive. 



Example #1 (Fourth Grade) 



flfTA * * m\ -oi r.^-fcrcs ft./l.- 

. ,/7ru <JL COO 0 ! 



C ^A(^U^ Aft. « i >cwfcto Q 
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Example #2 (Eighth Grade) 



.. rt' ...houo ...arc uou^ TiH^n 

. .'zP-. 'aou. cioctf(d 4o go 

l& con. r.)C&-A\i& 4\cvjimcx, 

1^Q5 .- (iiQfVh, JhQ tfrtamft and 
QV\ -VnCfca..ux^r T'd^li 0/60 

7&IQ6>. JOrCrar/QjIiv pMfcftote 
0<ooper and -the I'M (l£ tvfr„$m 

UQS and an 4liQl Af)4.u (tnt pm<? 
zone it'll . be. a blast. 

Qo toV...me VieUp^ o)^. "fiiml '.'in) 
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6. Skill Sheets 



The following examples illustrate the kinds of skill sheets that students 
included in their portfolios. 



Example #1 (Fourth Grade) 



1 Grammar: Sentences 



lit* b«for« pupil's pagss 3-10. 



A. Read the word groups below. If a word group is not a complete sentence, write nor 
a sentence under it. If the word group is a sentence, write it correctly, using capital 
letters and end punctuation. Then write whether it is a statement, a question, a 
request or command, or an exclamation. 



1. put this book away, please 

>i>T Thu< k^nY ,*rj,;^y o\p.n^^ « C c(T\ (Wcx na 





'/ i 



2. how^io^KHJ get to Edgewood Avenue 

3. after lunch, but before dinner 



4. monkeys are my favorite animals 

5. wow, what a fantastic game that was v / ,./.-, 

6. the exit on the left 

YVqT a Vp rfenr. 



B. Draw one line under the subject of each sentence Draw two lines under each 
predicate. 



7. That fM m was really scary. 

8. Big, gre eD- mQnste rs \irivaded the planet Earth. 

9. Earthlings were helpless against the creatures, 



10. A scientis t finally discovere d, the monsters' wea k spot 



No mo 
Pntust 



Copfgni r 1983 Or Mi»o«' A Row Pubuif\*n *nc , A 
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Example #2 (Eighth Grade) 



Backward Oval Letters 



The upper-case letters C and E 
are backward oval letters. 



Trace and write the letters. Write the joinings and words. 

n c r c r r c g g g 

UK £ I ',1 r r L ^ ^ 

Write the sentences, 

Explort mtant to traval to unknown lands. Countries wtrt formad whtn 
ntw lands wert discovarad. 
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Example #3 (Eighth Grade) 



Ou cx o. ct, CX. Os. C^CXCvtX 

cccc. CC c e c c 

£ JL 1 £ X Z L 

£11 JL 1- JLJlllh 

Intuitu 

*s>y\^ ^vn. ~r>ri» ^>7^ ^/yru ^>?o yv?v ^rTL 

/>i w SfL yy^ 



-A. ^ru -^U- 

-O^ 4* -V *&) ~& J&~^» 

£ ?z J: ± ± 

*<LL> J^L. .Aj„ ^C4— ^lA. ^\JW -Aa** -MJ ^tb 

y\T y^ /V ^xs-' 



^ . yri stL ~rtC S]L 

y ■> ■ , y" ~-y y -y y-Y 
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